Apr 12 06:17:31 user nova-compute[71711]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 12 06:17:33 user nova-compute[71711]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71711) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 06:17:33 user nova-compute[71711]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71711) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 06:17:33 user nova-compute[71711]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71711) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 06:17:33 user nova-compute[71711]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:17:34 user nova-compute[71711]: INFO nova.virt.driver [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 12 06:17:34 user nova-compute[71711]: INFO nova.compute.provider_config [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] Acquiring lock "singleton_lock" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] Acquired lock "singleton_lock" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] Releasing lock "singleton_lock" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] Full set of CONF: {{(pid=71711) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ******************************************************************************** {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] Configuration options gathered from: {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ================================================================================ {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] allow_resize_to_same_host      = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] arq_binding_timeout            = 300 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] backdoor_port                  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] backdoor_socket                = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] block_device_allocate_retries  = 300 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] block_device_allocate_retries_interval = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cert                           = self.pem {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute_monitors               = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] config_dir                     = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] config_drive_format            = iso9660 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] config_source                  = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] console_host                   = user {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] control_exchange               = nova {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cpu_allocation_ratio           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] daemon                         = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] debug                          = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] default_access_ip_network_name = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] default_availability_zone      = nova {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] default_ephemeral_format       = ext4 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] default_schedule_zone          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] disk_allocation_ratio          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] enable_new_services            = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] enabled_ssl_apis               = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] flat_injected                  = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] force_config_drive             = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] force_raw_images               = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] graceful_shutdown_timeout      = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] heal_instance_info_cache_interval = 60 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] host                           = user {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] instance_build_timeout         = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] instance_delete_interval       = 300 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] instance_name_template         = instance-%08x {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] instance_usage_audit           = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] instance_usage_audit_period    = month {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] internal_service_availability_zone = internal {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] key                            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] live_migration_retry_count     = 30 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] log_config_append              = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] log_dir                        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] log_file                       = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] log_options                    = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] log_rotate_interval            = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] log_rotate_interval_type       = days {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] log_rotation_type              = none {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] long_rpc_timeout               = 1800 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] max_concurrent_builds          = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] max_concurrent_live_migrations = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] max_concurrent_snapshots       = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] max_local_block_devices        = 3 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] max_logfile_count              = 30 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] max_logfile_size_mb            = 200 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] maximum_instance_delete_attempts = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] metadata_listen                = 0.0.0.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] metadata_listen_port           = 8775 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] metadata_workers               = 3 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] migrate_max_retries            = -1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] mkisofs_cmd                    = genisoimage {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] my_ip                          = 10.0.0.210 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] network_allocate_retries       = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] osapi_compute_listen_port      = 8774 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] osapi_compute_unique_server_name_scope =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] osapi_compute_workers          = 3 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] password_length                = 12 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] periodic_enable                = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] periodic_fuzzy_delay           = 60 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] pointer_model                  = ps2mouse {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] preallocate_images             = none {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] publish_errors                 = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] pybasedir                      = /opt/stack/nova {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ram_allocation_ratio           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] rate_limit_burst               = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] rate_limit_except_level        = CRITICAL {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] rate_limit_interval            = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] reboot_timeout                 = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] reclaim_instance_interval      = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] record                         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] reimage_timeout_per_gb         = 20 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] report_interval                = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] rescue_timeout                 = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] reserved_host_cpus             = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] reserved_host_disk_mb          = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] reserved_host_memory_mb        = 512 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] reserved_huge_pages            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] resize_confirm_window          = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] resize_fs_using_block_device   = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] resume_guests_state_on_host_boot = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] rpc_response_timeout           = 60 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] run_external_periodic_tasks    = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] running_deleted_instance_action = reap {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] running_deleted_instance_timeout = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] scheduler_instance_sync_interval = 120 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] service_down_time              = 60 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] servicegroup_driver            = db {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] shelved_offload_time           = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] shelved_poll_interval          = 3600 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] shutdown_timeout               = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] source_is_ipv6                 = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ssl_only                       = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] state_path                     = /opt/stack/data/nova {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] sync_power_state_interval      = 600 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] sync_power_state_pool_size     = 1000 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] syslog_log_facility            = LOG_USER {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] tempdir                        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] timeout_nbd                    = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] transport_url                  = **** {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] update_resources_interval      = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] use_cow_images                 = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] use_eventlog                   = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] use_journal                    = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] use_json                       = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] use_rootwrap_daemon            = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] use_stderr                     = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] use_syslog                     = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vcpu_pin_set                   = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plugging_is_fatal          = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plugging_timeout           = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] virt_mkfs                      = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] volume_usage_poll_interval     = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] watch_log_file                 = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] web                            = /usr/share/spice-html5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_concurrency.disable_process_locking = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.auth_strategy              = keystone {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.compute_link_prefix        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.dhcp_domain                = novalocal {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.enable_instance_password   = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.glance_link_prefix         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.instance_list_per_project_cells = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.list_records_by_skipping_down_cells = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.local_metadata_per_cell    = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.max_limit                  = 1000 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.metadata_cache_expiration  = 15 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.neutron_default_tenant_id  = default {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.use_forwarded_for          = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.use_neutron_default_nets   = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.vendordata_dynamic_targets = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.vendordata_jsonfile_path   = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.backend_argument         = **** {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.config_prefix            = cache.oslo {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.dead_timeout             = 60.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.debug_cache_backend      = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.enable_retry_client      = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.enable_socket_keepalive  = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.enabled                  = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.expiration_time          = 600 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.hashclient_retry_attempts = 2 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.memcache_dead_retry      = 300 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.memcache_password        =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.memcache_sasl_enabled    = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.memcache_username        =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.proxies                  = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.retry_attempts           = 2 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.retry_delay              = 0.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.socket_keepalive_count   = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.socket_keepalive_idle    = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.socket_keepalive_interval = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.tls_allowed_ciphers      = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.tls_cafile               = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.tls_certfile             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.tls_enabled              = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cache.tls_keyfile              = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.auth_section            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.auth_type               = password {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.cafile                  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.certfile                = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.collect_timing          = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.cross_az_attach         = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.debug                   = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.endpoint_template       = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.http_retries            = 3 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.insecure                = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.keyfile                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.os_region_name          = RegionOne {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.split_loggers           = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cinder.timeout                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute.cpu_dedicated_set      = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute.cpu_shared_set         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute.image_type_exclude_list = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute.resource_provider_association_refresh = 300 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute.shutdown_retry_interval = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] conductor.workers              = 3 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] console.allowed_origins        = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] console.ssl_ciphers            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] console.ssl_minimum_version    = default {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] consoleauth.token_ttl          = 600 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.cafile                  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.certfile                = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.collect_timing          = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.connect_retries         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.connect_retry_delay     = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.endpoint_override       = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.insecure                = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.keyfile                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.max_version             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.min_version             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.region_name             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.service_name            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.service_type            = accelerator {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.split_loggers           = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.status_code_retries     = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.status_code_retry_delay = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.timeout                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] cyborg.version                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.backend               = sqlalchemy {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.connection            = **** {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.connection_debug      = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.connection_parameters =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.connection_recycle_time = 3600 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.connection_trace      = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.db_inc_retry_interval = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.db_max_retries        = 20 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.db_max_retry_interval = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.db_retry_interval     = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.max_overflow          = 50 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.max_pool_size         = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.max_retries           = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.mysql_enable_ndb      = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.mysql_wsrep_sync_wait = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.pool_timeout          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.retry_interval        = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.slave_connection      = **** {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] database.sqlite_synchronous    = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.backend           = sqlalchemy {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.connection        = **** {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.connection_debug  = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.connection_parameters =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.connection_recycle_time = 3600 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.connection_trace  = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.db_inc_retry_interval = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.db_max_retries    = 20 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.db_max_retry_interval = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.db_retry_interval = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.max_overflow      = 50 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.max_pool_size     = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.max_retries       = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.mysql_enable_ndb  = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.pool_timeout      = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.retry_interval    = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.slave_connection  = **** {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] api_database.sqlite_synchronous = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] devices.enabled_mdev_types     = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ephemeral_storage_encryption.enabled = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.api_servers             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.cafile                  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.certfile                = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.collect_timing          = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.connect_retries         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.connect_retry_delay     = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.debug                   = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.default_trusted_certificate_ids = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.enable_certificate_validation = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.enable_rbd_download     = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.endpoint_override       = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.insecure                = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.keyfile                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.max_version             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.min_version             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.num_retries             = 3 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.rbd_ceph_conf           =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.rbd_connect_timeout     = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.rbd_pool                =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.rbd_user                =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.region_name             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.service_name            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.service_type            = image {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.split_loggers           = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.status_code_retries     = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.status_code_retry_delay = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.timeout                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.verify_glance_signatures = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] glance.version                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] guestfs.debug                  = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.config_drive_cdrom      = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.config_drive_inject_password = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.enable_remotefx         = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.instances_path_share    =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.limit_cpu_features      = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.use_multipath_io        = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.vswitch_name            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] mks.enabled                    = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] image_cache.manager_interval   = 2400 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] image_cache.precache_concurrency = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] image_cache.remove_unused_base_images = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] image_cache.subdirectory_name  = _base {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.api_max_retries         = 60 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.api_retry_interval      = 2 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.auth_section            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.auth_type               = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.cafile                  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.certfile                = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.collect_timing          = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.connect_retries         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.connect_retry_delay     = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.endpoint_override       = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.insecure                = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.keyfile                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.max_version             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.min_version             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.partition_key           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.peer_list               = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.region_name             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.serial_console_state_timeout = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.service_name            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.service_type            = baremetal {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.split_loggers           = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.status_code_retries     = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.status_code_retry_delay = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.timeout                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ironic.version                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] key_manager.fixed_key          = **** {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.barbican_api_version  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.barbican_endpoint     = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.barbican_endpoint_type = public {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.barbican_region_name  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.cafile                = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.certfile              = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.collect_timing        = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.insecure              = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.keyfile               = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.number_of_retries     = 60 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.retry_delay           = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.send_service_user_token = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.split_loggers         = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.timeout               = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.verify_ssl            = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican.verify_ssl_path       = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican_service_user.auth_section = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican_service_user.auth_type = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican_service_user.cafile   = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican_service_user.certfile = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican_service_user.collect_timing = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican_service_user.insecure = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican_service_user.keyfile  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican_service_user.split_loggers = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] barbican_service_user.timeout  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.approle_role_id          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.approle_secret_id        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.cafile                   = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.certfile                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.collect_timing           = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.insecure                 = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.keyfile                  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.kv_mountpoint            = secret {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.kv_version               = 2 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.namespace                = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.root_token_id            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.split_loggers            = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.ssl_ca_crt_file          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.timeout                  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.use_ssl                  = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.cafile                = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.certfile              = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.collect_timing        = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.connect_retries       = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.connect_retry_delay   = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.endpoint_override     = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.insecure              = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.keyfile               = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.max_version           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.min_version           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.region_name           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.service_name          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.service_type          = identity {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.split_loggers         = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.status_code_retries   = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.status_code_retry_delay = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.timeout               = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] keystone.version               = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.connection_uri         =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.cpu_mode               = custom {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: WARNING oslo_config.cfg [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.cpu_power_governor_high = performance {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.cpu_power_management   = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.device_detach_attempts = 8 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.device_detach_timeout  = 20 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.disk_cachemodes        = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.disk_prefix            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.enabled_perf_events    = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.file_backed_memory     = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.gid_maps               = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.hw_disk_discard        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.hw_machine_type        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.images_rbd_pool        = rbd {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.images_type            = default {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.images_volume_group    = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.inject_key             = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.inject_partition       = -2 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.inject_password        = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.iscsi_iface            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.iser_use_multipath     = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.live_migration_downtime = 500 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.live_migration_inbound_addr = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.live_migration_scheme  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.live_migration_timeout_action = abort {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.live_migration_tunnelled = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: WARNING oslo_config.cfg [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 12 06:17:34 user nova-compute[71711]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 12 06:17:34 user nova-compute[71711]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 12 06:17:34 user nova-compute[71711]: and ``live_migration_inbound_addr`` respectively.
Apr 12 06:17:34 user nova-compute[71711]: ).  Its value may be silently ignored in the future.
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.live_migration_with_native_tls = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.max_queues             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.nfs_mount_options      = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.num_pcie_ports         = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.pmem_namespaces        = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.quobyte_client_cfg     = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.rbd_secret_uuid        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.rbd_user               = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.rescue_image_id        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.rescue_kernel_id       = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.rx_queue_size          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.smbfs_mount_options    =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.snapshot_compression   = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.snapshot_image_format  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.sparse_logical_volumes = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.swtpm_enabled          = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.swtpm_group            = tss {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.swtpm_user             = tss {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.sysinfo_serial         = unique {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.tx_queue_size          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.uid_maps               = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.use_virtio_for_bridges = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.virt_type              = kvm {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.volume_clear           = zero {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.volume_clear_size      = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.volume_use_multipath   = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.vzstorage_cache_path   = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.auth_section           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.auth_type              = password {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.cafile                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.certfile               = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.collect_timing         = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.connect_retries        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.connect_retry_delay    = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.default_floating_pool  = public {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.endpoint_override      = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.extension_sync_interval = 600 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.http_retries           = 3 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.insecure               = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.keyfile                = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.max_version            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.min_version            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.ovs_bridge             = br-int {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.physnets               = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.region_name            = RegionOne {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.service_metadata_proxy = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.service_name           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.service_type           = network {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.split_loggers          = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.status_code_retries    = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.status_code_retry_delay = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.timeout                = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] neutron.version                = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] notifications.bdms_in_notifications = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] notifications.default_level    = INFO {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] notifications.notification_format = unversioned {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] notifications.notify_on_state_change = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] pci.alias                      = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] pci.device_spec                = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] pci.report_in_placement        = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.auth_section         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.auth_type            = password {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.cafile               = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.certfile             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.collect_timing       = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.connect_retries      = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.connect_retry_delay  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.default_domain_id    = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.default_domain_name  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.domain_id            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.domain_name          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.endpoint_override    = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.insecure             = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.keyfile              = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.max_version          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.min_version          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.password             = **** {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.project_domain_id    = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.project_domain_name  = Default {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.project_id           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.project_name         = service {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.region_name          = RegionOne {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.service_name         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.service_type         = placement {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.split_loggers        = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.status_code_retries  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.status_code_retry_delay = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.system_scope         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.timeout              = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.trust_id             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.user_domain_id       = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.user_domain_name     = Default {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.user_id              = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.username             = placement {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] placement.version              = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] quota.cores                    = 20 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] quota.count_usage_from_placement = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] quota.injected_file_content_bytes = 10240 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] quota.injected_file_path_length = 255 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] quota.injected_files           = 5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] quota.instances                = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] quota.key_pairs                = 100 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] quota.metadata_items           = 128 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] quota.ram                      = 51200 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] quota.recheck_quota            = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] quota.server_group_members     = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] quota.server_groups            = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] rdp.enabled                    = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] scheduler.image_metadata_prefilter = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] scheduler.max_attempts         = 3 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] scheduler.max_placement_results = 1000 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] scheduler.workers              = 3 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.host_subset_size = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.isolated_hosts = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.isolated_images = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.pci_in_placement = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.track_instance_changes = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] metrics.required               = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] metrics.weight_multiplier      = 1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] metrics.weight_setting         = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] serial_console.enabled         = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] serial_console.port_range      = 10000:20000 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] serial_console.serialproxy_port = 6083 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] service_user.auth_section      = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] service_user.auth_type         = password {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] service_user.cafile            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] service_user.certfile          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] service_user.collect_timing    = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] service_user.insecure          = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] service_user.keyfile           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] service_user.send_service_user_token = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] service_user.split_loggers     = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] service_user.timeout           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] spice.agent_enabled            = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] spice.enabled                  = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] spice.html5proxy_port          = 6082 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] spice.image_compression        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] spice.jpeg_compression         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] spice.playback_compression     = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] spice.server_listen            = 127.0.0.1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] spice.streaming_mode           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] spice.zlib_compression         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] upgrade_levels.baseapi         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] upgrade_levels.cert            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] upgrade_levels.compute         = auto {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] upgrade_levels.conductor       = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] upgrade_levels.scheduler       = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vendordata_dynamic_auth.cafile = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vendordata_dynamic_auth.certfile = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vendordata_dynamic_auth.insecure = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vendordata_dynamic_auth.timeout = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.api_retry_count         = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.ca_file                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.cache_prefix            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.cluster_name            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.connection_pool_size    = 10 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.console_delay_seconds   = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.datastore_regex         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.host_ip                 = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.host_password           = **** {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.host_port               = 443 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.host_username           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.insecure                = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.integration_bridge      = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.maximum_objects         = 100 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.pbm_default_policy      = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.pbm_enabled             = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.pbm_wsdl_location       = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.serial_port_proxy_uri   = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.serial_port_service_uri = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.task_poll_interval      = 0.5 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.use_linked_clone        = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.vnc_keymap              = en-us {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.vnc_port                = 5900 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vmware.vnc_port_total          = 10000 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vnc.auth_schemes               = ['none'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vnc.enabled                    = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vnc.novncproxy_port            = 6080 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vnc.vencrypt_ca_certs          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vnc.vencrypt_client_cert       = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vnc.vencrypt_client_key        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.disable_rootwrap   = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.enable_numa_live_migration = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.libvirt_disable_apic = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] wsgi.client_socket_timeout     = 900 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] wsgi.default_pool_size         = 1000 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] wsgi.keep_alive                = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] wsgi.max_header_line           = 16384 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] wsgi.ssl_ca_file               = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] wsgi.ssl_cert_file             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] wsgi.ssl_key_file              = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] wsgi.tcp_keepidle              = 600 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] zvm.ca_file                    = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] zvm.cloud_connector_url        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] zvm.reachable_timeout          = 300 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_policy.enforce_new_defaults = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_policy.enforce_scope      = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_policy.policy_default_rule = default {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] profiler.connection_string     = messaging:// {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] profiler.enabled               = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] profiler.es_doc_type           = notification {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] profiler.es_scroll_size        = 10000 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] profiler.es_scroll_time        = 2m {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] profiler.filter_error_trace    = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] profiler.sentinel_service_name = mymaster {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] profiler.socket_timeout        = 0.1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] profiler.trace_sqlalchemy      = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] remote_debug.host              = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] remote_debug.port              = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_notifications.retry = -1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.auth_section        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.auth_type           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.cafile              = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.certfile            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.collect_timing      = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.connect_retries     = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.connect_retry_delay = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.endpoint_id         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.endpoint_override   = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.insecure            = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.keyfile             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.max_version         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.min_version         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.region_name         = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.service_name        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.service_type        = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.split_loggers       = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.status_code_retries = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.status_code_retry_delay = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.timeout             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.valid_interfaces    = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_limit.version             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_reports.file_event_handler = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] oslo_reports.log_dir           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plug_ovs_privileged.group  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] vif_plug_ovs_privileged.user   = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_ovs.isolate_vif         = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] os_brick.lock_path             = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] privsep_osbrick.capabilities   = [21] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] privsep_osbrick.group          = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] privsep_osbrick.helper_command = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] privsep_osbrick.user           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] nova_sys_admin.group           = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] nova_sys_admin.helper_command  = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] nova_sys_admin.user            = None {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG oslo_service.service [None req-763d4905-f509-46df-afba-1e8c2e03e9b0 None None] ******************************************************************************** {{(pid=71711) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 12 06:17:34 user nova-compute[71711]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 12 06:17:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Starting native event thread {{(pid=71711) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Starting green dispatch thread {{(pid=71711) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Starting connection event dispatch thread {{(pid=71711) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Connecting to libvirt: qemu:///system {{(pid=71711) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f995debe650> {{(pid=71711) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 12 06:17:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f995debe650> {{(pid=71711) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 12 06:17:34 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Connection event '1' reason 'None'
Apr 12 06:17:34 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 06:17:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.mount [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Initialising _HostMountState generation 0 {{(pid=71711) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 12 06:17:41 user nova-compute[71711]: INFO nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Libvirt host capabilities <capabilities>
Apr 12 06:17:41 user nova-compute[71711]:   <host>
Apr 12 06:17:41 user nova-compute[71711]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 12 06:17:41 user nova-compute[71711]:     <cpu>
Apr 12 06:17:41 user nova-compute[71711]:       <arch>x86_64</arch>
Apr 12 06:17:41 user nova-compute[71711]:       <model>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <vendor>Intel</vendor>
Apr 12 06:17:41 user nova-compute[71711]:       <microcode version='1070'/>
Apr 12 06:17:41 user nova-compute[71711]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 12 06:17:41 user nova-compute[71711]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='ss'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='vmx'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='pcid'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='osxsave'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='hypervisor'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='arat'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='tsc_adjust'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='md-clear'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='arch-capabilities'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='invtsc'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='rsba'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature name='skip-l1dfl-vmentry'/>
Apr 12 06:17:41 user nova-compute[71711]:       <pages unit='KiB' size='4'/>
Apr 12 06:17:41 user nova-compute[71711]:       <pages unit='KiB' size='2048'/>
Apr 12 06:17:41 user nova-compute[71711]:     </cpu>
Apr 12 06:17:41 user nova-compute[71711]:     <power_management>
Apr 12 06:17:41 user nova-compute[71711]:       <suspend_mem/>
Apr 12 06:17:41 user nova-compute[71711]:       <suspend_disk/>
Apr 12 06:17:41 user nova-compute[71711]:       <suspend_hybrid/>
Apr 12 06:17:41 user nova-compute[71711]:     </power_management>
Apr 12 06:17:41 user nova-compute[71711]:     <iommu support='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     <migration_features>
Apr 12 06:17:41 user nova-compute[71711]:       <live/>
Apr 12 06:17:41 user nova-compute[71711]:       <uri_transports>
Apr 12 06:17:41 user nova-compute[71711]:         <uri_transport>tcp</uri_transport>
Apr 12 06:17:41 user nova-compute[71711]:         <uri_transport>rdma</uri_transport>
Apr 12 06:17:41 user nova-compute[71711]:       </uri_transports>
Apr 12 06:17:41 user nova-compute[71711]:     </migration_features>
Apr 12 06:17:41 user nova-compute[71711]:     <topology>
Apr 12 06:17:41 user nova-compute[71711]:       <cells num='2'>
Apr 12 06:17:41 user nova-compute[71711]:         <cell id='0'>
Apr 12 06:17:41 user nova-compute[71711]:           <memory unit='KiB'>8189224</memory>
Apr 12 06:17:41 user nova-compute[71711]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 12 06:17:41 user nova-compute[71711]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 06:17:41 user nova-compute[71711]:           <distances>
Apr 12 06:17:41 user nova-compute[71711]:             <sibling id='0' value='10'/>
Apr 12 06:17:41 user nova-compute[71711]:             <sibling id='1' value='20'/>
Apr 12 06:17:41 user nova-compute[71711]:           </distances>
Apr 12 06:17:41 user nova-compute[71711]:           <cpus num='6'>
Apr 12 06:17:41 user nova-compute[71711]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 12 06:17:41 user nova-compute[71711]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 12 06:17:41 user nova-compute[71711]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 12 06:17:41 user nova-compute[71711]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 12 06:17:41 user nova-compute[71711]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 12 06:17:41 user nova-compute[71711]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 12 06:17:41 user nova-compute[71711]:           </cpus>
Apr 12 06:17:41 user nova-compute[71711]:         </cell>
Apr 12 06:17:41 user nova-compute[71711]:         <cell id='1'>
Apr 12 06:17:41 user nova-compute[71711]:           <memory unit='KiB'>8218764</memory>
Apr 12 06:17:41 user nova-compute[71711]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 12 06:17:41 user nova-compute[71711]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 06:17:41 user nova-compute[71711]:           <distances>
Apr 12 06:17:41 user nova-compute[71711]:             <sibling id='0' value='20'/>
Apr 12 06:17:41 user nova-compute[71711]:             <sibling id='1' value='10'/>
Apr 12 06:17:41 user nova-compute[71711]:           </distances>
Apr 12 06:17:41 user nova-compute[71711]:           <cpus num='6'>
Apr 12 06:17:41 user nova-compute[71711]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 12 06:17:41 user nova-compute[71711]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 12 06:17:41 user nova-compute[71711]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 12 06:17:41 user nova-compute[71711]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 12 06:17:41 user nova-compute[71711]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 12 06:17:41 user nova-compute[71711]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 12 06:17:41 user nova-compute[71711]:           </cpus>
Apr 12 06:17:41 user nova-compute[71711]:         </cell>
Apr 12 06:17:41 user nova-compute[71711]:       </cells>
Apr 12 06:17:41 user nova-compute[71711]:     </topology>
Apr 12 06:17:41 user nova-compute[71711]:     <cache>
Apr 12 06:17:41 user nova-compute[71711]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 12 06:17:41 user nova-compute[71711]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 12 06:17:41 user nova-compute[71711]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 12 06:17:41 user nova-compute[71711]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 12 06:17:41 user nova-compute[71711]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 12 06:17:41 user nova-compute[71711]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 12 06:17:41 user nova-compute[71711]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 12 06:17:41 user nova-compute[71711]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 12 06:17:41 user nova-compute[71711]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 12 06:17:41 user nova-compute[71711]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 12 06:17:41 user nova-compute[71711]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 12 06:17:41 user nova-compute[71711]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 12 06:17:41 user nova-compute[71711]:     </cache>
Apr 12 06:17:41 user nova-compute[71711]:     <secmodel>
Apr 12 06:17:41 user nova-compute[71711]:       <model>apparmor</model>
Apr 12 06:17:41 user nova-compute[71711]:       <doi>0</doi>
Apr 12 06:17:41 user nova-compute[71711]:     </secmodel>
Apr 12 06:17:41 user nova-compute[71711]:     <secmodel>
Apr 12 06:17:41 user nova-compute[71711]:       <model>dac</model>
Apr 12 06:17:41 user nova-compute[71711]:       <doi>0</doi>
Apr 12 06:17:41 user nova-compute[71711]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 12 06:17:41 user nova-compute[71711]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 12 06:17:41 user nova-compute[71711]:     </secmodel>
Apr 12 06:17:41 user nova-compute[71711]:   </host>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='alpha'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>64</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>clipper</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='armv6l'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>spitz</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>nuri</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>kzm</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sx1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>z2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>tosa</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>n810</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>n800</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>terrier</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>midway</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>microbit</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>verdex</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>highbank</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>akita</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>connex</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>collie</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='armv7l'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>spitz</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>nuri</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>kzm</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sx1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>z2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>tosa</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>n810</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>n800</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>terrier</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>midway</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>microbit</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>verdex</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>highbank</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>akita</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>connex</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>collie</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='aarch64'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>64</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>spitz</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>nuri</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>kzm</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sx1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>z2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>tosa</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>n810</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>n800</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>terrier</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>midway</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>microbit</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>verdex</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>raspi3b</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>highbank</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>akita</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>connex</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>collie</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <acpi default='on' toggle='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='cris'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='i686'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>isapc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>microvm</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='kvm'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <pae/>
Apr 12 06:17:41 user nova-compute[71711]:       <nonpae/>
Apr 12 06:17:41 user nova-compute[71711]:       <acpi default='on' toggle='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:       <apic default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='m68k'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>an5206</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>q800</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>next-cube</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='microblaze'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='microblazeel'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='mips'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='16'>malta</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='mipsel'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='16'>malta</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='mips64'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>64</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='16'>malta</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>pica61</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>magnum</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='mips64el'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>64</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='16'>malta</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>pica61</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>magnum</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='16'>boston</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='ppc'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mac99</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>40p</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>taihu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='ppc64'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>64</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>taihu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>40p</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mac99</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='ppc64le'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>64</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>taihu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>40p</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>mac99</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='riscv32'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='8'>spike</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>opentitan</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='8'>virt</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='riscv64'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>64</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='8'>spike</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>shakti_c</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='8'>virt</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='s390x'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>64</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='sh4'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>shix</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>r2d</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='sh4eb'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>64</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>shix</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>r2d</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='sparc'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>SS-5</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>SS-20</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>LX</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>SS-4</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>SS-10</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>Voyager</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='sparc64'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>64</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sun4u</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>niagara</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>sun4v</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='x86_64'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>64</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='1'>isapc</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>microvm</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='kvm'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <acpi default='on' toggle='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:       <apic default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='xtensa'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>sim</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>kc705</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>ml605</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>virt</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>lx200</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>lx60</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]:   <guest>
Apr 12 06:17:41 user nova-compute[71711]:     <os_type>hvm</os_type>
Apr 12 06:17:41 user nova-compute[71711]:     <arch name='xtensaeb'>
Apr 12 06:17:41 user nova-compute[71711]:       <wordsize>32</wordsize>
Apr 12 06:17:41 user nova-compute[71711]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='4'>sim</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>kc705</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>ml605</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>virt</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>lx200</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>lx60</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 06:17:41 user nova-compute[71711]:       <domain type='qemu'/>
Apr 12 06:17:41 user nova-compute[71711]:     </arch>
Apr 12 06:17:41 user nova-compute[71711]:     <features>
Apr 12 06:17:41 user nova-compute[71711]:       <cpuselection/>
Apr 12 06:17:41 user nova-compute[71711]:       <deviceboot/>
Apr 12 06:17:41 user nova-compute[71711]:       <disksnapshot default='on' toggle='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     </features>
Apr 12 06:17:41 user nova-compute[71711]:   </guest>
Apr 12 06:17:41 user nova-compute[71711]: </capabilities>
Apr 12 06:17:41 user nova-compute[71711]: 
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 12 06:17:41 user nova-compute[71711]: <domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 06:17:41 user nova-compute[71711]:   <domain>kvm</domain>
Apr 12 06:17:41 user nova-compute[71711]:   <machine>pc-i440fx-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:   <arch>i686</arch>
Apr 12 06:17:41 user nova-compute[71711]:   <vcpu max='255'/>
Apr 12 06:17:41 user nova-compute[71711]:   <iothreads supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:   <os supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='firmware'/>
Apr 12 06:17:41 user nova-compute[71711]:     <loader supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>rom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pflash</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='readonly'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>yes</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='secure'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </loader>
Apr 12 06:17:41 user nova-compute[71711]:   </os>
Apr 12 06:17:41 user nova-compute[71711]:   <cpu>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-passthrough' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='hostPassthroughMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='maximum' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='maximumMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>on</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-model' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <vendor>Intel</vendor>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ss'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='vmx'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='pcid'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='hypervisor'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arat'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='umip'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='md-clear'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibpb'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibrs'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='erms'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='lm'/>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='custom' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>qemu64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>qemu32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>phenom</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>n270</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>kvm64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>kvm32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>coreduo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>core2duo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>athlon</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Westmere</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Snowridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Penryn</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G5</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G4</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G1</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Nehalem</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Rome</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Milan</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Dhyana</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cooperlake</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Conroe</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>486</model>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:   </cpu>
Apr 12 06:17:41 user nova-compute[71711]:   <memoryBacking supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='sourceType'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>file</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>anonymous</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>memfd</value>
Apr 12 06:17:41 user nova-compute[71711]:     </enum>
Apr 12 06:17:41 user nova-compute[71711]:   </memoryBacking>
Apr 12 06:17:41 user nova-compute[71711]:   <devices>
Apr 12 06:17:41 user nova-compute[71711]:     <disk supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='diskDevice'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>disk</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cdrom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>floppy</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>lun</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='bus'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>ide</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>fdc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sata</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </disk>
Apr 12 06:17:41 user nova-compute[71711]:     <graphics supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sdl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vnc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>spice</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egl-headless</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </graphics>
Apr 12 06:17:41 user nova-compute[71711]:     <video supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='modelType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cirrus</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vmvga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>qxl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>none</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>bochs</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>ramfb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </video>
Apr 12 06:17:41 user nova-compute[71711]:     <hostdev supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='mode'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>subsystem</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='startupPolicy'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>default</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>mandatory</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>requisite</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>optional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='subsysType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pci</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='capsType'/>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='pciBackend'/>
Apr 12 06:17:41 user nova-compute[71711]:     </hostdev>
Apr 12 06:17:41 user nova-compute[71711]:     <rng supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>random</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egd</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>builtin</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </rng>
Apr 12 06:17:41 user nova-compute[71711]:     <filesystem supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='driverType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>path</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>handle</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtiofs</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </filesystem>
Apr 12 06:17:41 user nova-compute[71711]:     <tpm supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-tis</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-crb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>passthrough</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>emulator</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </tpm>
Apr 12 06:17:41 user nova-compute[71711]:   </devices>
Apr 12 06:17:41 user nova-compute[71711]:   <features>
Apr 12 06:17:41 user nova-compute[71711]:     <gic supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     <vmcoreinfo supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <genid supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backingStoreInput supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backup supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <sev supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:   </features>
Apr 12 06:17:41 user nova-compute[71711]: </domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:  {{(pid=71711) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 12 06:17:41 user nova-compute[71711]: <domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 06:17:41 user nova-compute[71711]:   <domain>kvm</domain>
Apr 12 06:17:41 user nova-compute[71711]:   <machine>pc-i440fx-jammy</machine>
Apr 12 06:17:41 user nova-compute[71711]:   <arch>i686</arch>
Apr 12 06:17:41 user nova-compute[71711]:   <vcpu max='255'/>
Apr 12 06:17:41 user nova-compute[71711]:   <iothreads supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:   <os supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='firmware'/>
Apr 12 06:17:41 user nova-compute[71711]:     <loader supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>rom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pflash</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='readonly'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>yes</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='secure'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </loader>
Apr 12 06:17:41 user nova-compute[71711]:   </os>
Apr 12 06:17:41 user nova-compute[71711]:   <cpu>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-passthrough' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='hostPassthroughMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='maximum' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='maximumMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>on</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-model' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <vendor>Intel</vendor>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ss'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='vmx'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='pcid'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='hypervisor'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arat'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='umip'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='md-clear'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibpb'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibrs'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='erms'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='lm'/>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='custom' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>qemu64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>qemu32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>phenom</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>n270</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>kvm64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>kvm32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>coreduo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>core2duo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>athlon</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Westmere</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Snowridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Penryn</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G5</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G4</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G1</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Nehalem</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Rome</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Milan</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Dhyana</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cooperlake</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Conroe</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>486</model>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:   </cpu>
Apr 12 06:17:41 user nova-compute[71711]:   <memoryBacking supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='sourceType'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>file</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>anonymous</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>memfd</value>
Apr 12 06:17:41 user nova-compute[71711]:     </enum>
Apr 12 06:17:41 user nova-compute[71711]:   </memoryBacking>
Apr 12 06:17:41 user nova-compute[71711]:   <devices>
Apr 12 06:17:41 user nova-compute[71711]:     <disk supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='diskDevice'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>disk</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cdrom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>floppy</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>lun</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='bus'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>ide</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>fdc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sata</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </disk>
Apr 12 06:17:41 user nova-compute[71711]:     <graphics supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sdl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vnc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>spice</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egl-headless</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </graphics>
Apr 12 06:17:41 user nova-compute[71711]:     <video supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='modelType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cirrus</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vmvga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>qxl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>none</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>bochs</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>ramfb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </video>
Apr 12 06:17:41 user nova-compute[71711]:     <hostdev supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='mode'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>subsystem</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='startupPolicy'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>default</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>mandatory</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>requisite</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>optional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='subsysType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pci</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='capsType'/>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='pciBackend'/>
Apr 12 06:17:41 user nova-compute[71711]:     </hostdev>
Apr 12 06:17:41 user nova-compute[71711]:     <rng supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>random</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egd</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>builtin</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </rng>
Apr 12 06:17:41 user nova-compute[71711]:     <filesystem supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='driverType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>path</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>handle</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtiofs</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </filesystem>
Apr 12 06:17:41 user nova-compute[71711]:     <tpm supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-tis</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-crb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>passthrough</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>emulator</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </tpm>
Apr 12 06:17:41 user nova-compute[71711]:   </devices>
Apr 12 06:17:41 user nova-compute[71711]:   <features>
Apr 12 06:17:41 user nova-compute[71711]:     <gic supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     <vmcoreinfo supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <genid supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backingStoreInput supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backup supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <sev supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:   </features>
Apr 12 06:17:41 user nova-compute[71711]: </domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:  {{(pid=71711) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 12 06:17:41 user nova-compute[71711]: <domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 06:17:41 user nova-compute[71711]:   <domain>kvm</domain>
Apr 12 06:17:41 user nova-compute[71711]:   <machine>pc-q35-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:   <arch>i686</arch>
Apr 12 06:17:41 user nova-compute[71711]:   <vcpu max='288'/>
Apr 12 06:17:41 user nova-compute[71711]:   <iothreads supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:   <os supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='firmware'/>
Apr 12 06:17:41 user nova-compute[71711]:     <loader supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>rom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pflash</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='readonly'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>yes</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='secure'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </loader>
Apr 12 06:17:41 user nova-compute[71711]:   </os>
Apr 12 06:17:41 user nova-compute[71711]:   <cpu>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-passthrough' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='hostPassthroughMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='maximum' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='maximumMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>on</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-model' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <vendor>Intel</vendor>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ss'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='vmx'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='pcid'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='hypervisor'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arat'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='umip'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='md-clear'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibpb'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibrs'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='erms'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='lm'/>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='custom' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>qemu64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>qemu32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>phenom</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>n270</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>kvm64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>kvm32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>coreduo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>core2duo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>athlon</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Westmere</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Snowridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Penryn</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G5</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G4</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G1</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Nehalem</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Rome</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Milan</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Dhyana</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cooperlake</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Conroe</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>486</model>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:   </cpu>
Apr 12 06:17:41 user nova-compute[71711]:   <memoryBacking supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='sourceType'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>file</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>anonymous</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>memfd</value>
Apr 12 06:17:41 user nova-compute[71711]:     </enum>
Apr 12 06:17:41 user nova-compute[71711]:   </memoryBacking>
Apr 12 06:17:41 user nova-compute[71711]:   <devices>
Apr 12 06:17:41 user nova-compute[71711]:     <disk supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='diskDevice'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>disk</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cdrom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>floppy</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>lun</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='bus'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>fdc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sata</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </disk>
Apr 12 06:17:41 user nova-compute[71711]:     <graphics supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sdl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vnc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>spice</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egl-headless</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </graphics>
Apr 12 06:17:41 user nova-compute[71711]:     <video supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='modelType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cirrus</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vmvga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>qxl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>none</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>bochs</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>ramfb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </video>
Apr 12 06:17:41 user nova-compute[71711]:     <hostdev supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='mode'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>subsystem</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='startupPolicy'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>default</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>mandatory</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>requisite</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>optional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='subsysType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pci</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='capsType'/>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='pciBackend'/>
Apr 12 06:17:41 user nova-compute[71711]:     </hostdev>
Apr 12 06:17:41 user nova-compute[71711]:     <rng supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>random</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egd</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>builtin</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </rng>
Apr 12 06:17:41 user nova-compute[71711]:     <filesystem supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='driverType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>path</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>handle</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtiofs</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </filesystem>
Apr 12 06:17:41 user nova-compute[71711]:     <tpm supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-tis</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-crb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>passthrough</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>emulator</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </tpm>
Apr 12 06:17:41 user nova-compute[71711]:   </devices>
Apr 12 06:17:41 user nova-compute[71711]:   <features>
Apr 12 06:17:41 user nova-compute[71711]:     <gic supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     <vmcoreinfo supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <genid supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backingStoreInput supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backup supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <sev supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:   </features>
Apr 12 06:17:41 user nova-compute[71711]: </domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:  {{(pid=71711) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 12 06:17:41 user nova-compute[71711]: <domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 06:17:41 user nova-compute[71711]:   <domain>kvm</domain>
Apr 12 06:17:41 user nova-compute[71711]:   <machine>pc-q35-jammy</machine>
Apr 12 06:17:41 user nova-compute[71711]:   <arch>i686</arch>
Apr 12 06:17:41 user nova-compute[71711]:   <vcpu max='288'/>
Apr 12 06:17:41 user nova-compute[71711]:   <iothreads supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:   <os supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='firmware'/>
Apr 12 06:17:41 user nova-compute[71711]:     <loader supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>rom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pflash</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='readonly'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>yes</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='secure'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </loader>
Apr 12 06:17:41 user nova-compute[71711]:   </os>
Apr 12 06:17:41 user nova-compute[71711]:   <cpu>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-passthrough' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='hostPassthroughMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='maximum' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='maximumMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>on</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-model' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <vendor>Intel</vendor>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ss'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='vmx'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='pcid'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='hypervisor'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arat'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='umip'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='md-clear'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibpb'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibrs'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='erms'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='lm'/>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='custom' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>qemu64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>qemu32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>phenom</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>n270</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>kvm64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>kvm32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>coreduo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>core2duo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>athlon</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Westmere</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Snowridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Penryn</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G5</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G4</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G1</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Nehalem</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Rome</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Milan</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Dhyana</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cooperlake</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Conroe</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>486</model>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:   </cpu>
Apr 12 06:17:41 user nova-compute[71711]:   <memoryBacking supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='sourceType'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>file</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>anonymous</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>memfd</value>
Apr 12 06:17:41 user nova-compute[71711]:     </enum>
Apr 12 06:17:41 user nova-compute[71711]:   </memoryBacking>
Apr 12 06:17:41 user nova-compute[71711]:   <devices>
Apr 12 06:17:41 user nova-compute[71711]:     <disk supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='diskDevice'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>disk</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cdrom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>floppy</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>lun</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='bus'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>fdc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sata</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </disk>
Apr 12 06:17:41 user nova-compute[71711]:     <graphics supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sdl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vnc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>spice</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egl-headless</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </graphics>
Apr 12 06:17:41 user nova-compute[71711]:     <video supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='modelType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cirrus</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vmvga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>qxl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>none</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>bochs</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>ramfb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </video>
Apr 12 06:17:41 user nova-compute[71711]:     <hostdev supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='mode'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>subsystem</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='startupPolicy'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>default</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>mandatory</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>requisite</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>optional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='subsysType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pci</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='capsType'/>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='pciBackend'/>
Apr 12 06:17:41 user nova-compute[71711]:     </hostdev>
Apr 12 06:17:41 user nova-compute[71711]:     <rng supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>random</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egd</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>builtin</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </rng>
Apr 12 06:17:41 user nova-compute[71711]:     <filesystem supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='driverType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>path</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>handle</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtiofs</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </filesystem>
Apr 12 06:17:41 user nova-compute[71711]:     <tpm supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-tis</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-crb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>passthrough</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>emulator</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </tpm>
Apr 12 06:17:41 user nova-compute[71711]:   </devices>
Apr 12 06:17:41 user nova-compute[71711]:   <features>
Apr 12 06:17:41 user nova-compute[71711]:     <gic supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     <vmcoreinfo supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <genid supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backingStoreInput supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backup supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <sev supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:   </features>
Apr 12 06:17:41 user nova-compute[71711]: </domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:  {{(pid=71711) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 12 06:17:41 user nova-compute[71711]: <domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 06:17:41 user nova-compute[71711]:   <domain>kvm</domain>
Apr 12 06:17:41 user nova-compute[71711]:   <machine>pc-i440fx-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:   <arch>x86_64</arch>
Apr 12 06:17:41 user nova-compute[71711]:   <vcpu max='255'/>
Apr 12 06:17:41 user nova-compute[71711]:   <iothreads supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:   <os supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='firmware'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>efi</value>
Apr 12 06:17:41 user nova-compute[71711]:     </enum>
Apr 12 06:17:41 user nova-compute[71711]:     <loader supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>rom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pflash</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='readonly'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>yes</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='secure'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </loader>
Apr 12 06:17:41 user nova-compute[71711]:   </os>
Apr 12 06:17:41 user nova-compute[71711]:   <cpu>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-passthrough' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='hostPassthroughMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>on</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='maximum' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='maximumMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>on</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-model' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <vendor>Intel</vendor>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ss'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='vmx'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='pcid'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='hypervisor'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arat'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='umip'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='md-clear'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='invtsc'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibpb'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibrs'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='rsba'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='erms'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='custom' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>qemu64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>qemu32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>phenom</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>n270</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>kvm64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>kvm32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>coreduo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>core2duo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>athlon</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Westmere</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Snowridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Penryn</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G5</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G4</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Opteron_G1</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Nehalem</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Rome</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Milan</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Dhyana</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cooperlake</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Conroe</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>486</model>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:   </cpu>
Apr 12 06:17:41 user nova-compute[71711]:   <memoryBacking supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='sourceType'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>file</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>anonymous</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>memfd</value>
Apr 12 06:17:41 user nova-compute[71711]:     </enum>
Apr 12 06:17:41 user nova-compute[71711]:   </memoryBacking>
Apr 12 06:17:41 user nova-compute[71711]:   <devices>
Apr 12 06:17:41 user nova-compute[71711]:     <disk supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='diskDevice'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>disk</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cdrom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>floppy</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>lun</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='bus'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>ide</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>fdc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sata</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </disk>
Apr 12 06:17:41 user nova-compute[71711]:     <graphics supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sdl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vnc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>spice</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egl-headless</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </graphics>
Apr 12 06:17:41 user nova-compute[71711]:     <video supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='modelType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cirrus</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vmvga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>qxl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>none</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>bochs</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>ramfb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </video>
Apr 12 06:17:41 user nova-compute[71711]:     <hostdev supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='mode'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>subsystem</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='startupPolicy'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>default</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>mandatory</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>requisite</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>optional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='subsysType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pci</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='capsType'/>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='pciBackend'/>
Apr 12 06:17:41 user nova-compute[71711]:     </hostdev>
Apr 12 06:17:41 user nova-compute[71711]:     <rng supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>random</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egd</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>builtin</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </rng>
Apr 12 06:17:41 user nova-compute[71711]:     <filesystem supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='driverType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>path</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>handle</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtiofs</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </filesystem>
Apr 12 06:17:41 user nova-compute[71711]:     <tpm supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-tis</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-crb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>passthrough</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>emulator</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </tpm>
Apr 12 06:17:41 user nova-compute[71711]:   </devices>
Apr 12 06:17:41 user nova-compute[71711]:   <features>
Apr 12 06:17:41 user nova-compute[71711]:     <gic supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     <vmcoreinfo supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <genid supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backingStoreInput supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backup supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <sev supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:   </features>
Apr 12 06:17:41 user nova-compute[71711]: </domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:  {{(pid=71711) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 12 06:17:41 user nova-compute[71711]: <domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 06:17:41 user nova-compute[71711]:   <domain>kvm</domain>
Apr 12 06:17:41 user nova-compute[71711]:   <machine>pc-i440fx-jammy</machine>
Apr 12 06:17:41 user nova-compute[71711]:   <arch>x86_64</arch>
Apr 12 06:17:41 user nova-compute[71711]:   <vcpu max='255'/>
Apr 12 06:17:41 user nova-compute[71711]:   <iothreads supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:   <os supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='firmware'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>efi</value>
Apr 12 06:17:41 user nova-compute[71711]:     </enum>
Apr 12 06:17:41 user nova-compute[71711]:     <loader supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>rom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pflash</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='readonly'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>yes</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='secure'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </loader>
Apr 12 06:17:41 user nova-compute[71711]:   </os>
Apr 12 06:17:41 user nova-compute[71711]:   <cpu>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-passthrough' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='hostPassthroughMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>on</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='maximum' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='maximumMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>on</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-model' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <vendor>Intel</vendor>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ss'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='vmx'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='pcid'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='hypervisor'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arat'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='umip'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='md-clear'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='invtsc'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibpb'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibrs'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='rsba'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='erms'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='custom' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>qemu64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>qemu32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>phenom</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>n270</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>kvm64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>kvm32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>coreduo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>core2duo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>athlon</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Westmere</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Snowridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Penryn</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G5</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G4</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Opteron_G1</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Nehalem</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Rome</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Milan</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Dhyana</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cooperlake</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Conroe</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>486</model>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:   </cpu>
Apr 12 06:17:41 user nova-compute[71711]:   <memoryBacking supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='sourceType'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>file</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>anonymous</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>memfd</value>
Apr 12 06:17:41 user nova-compute[71711]:     </enum>
Apr 12 06:17:41 user nova-compute[71711]:   </memoryBacking>
Apr 12 06:17:41 user nova-compute[71711]:   <devices>
Apr 12 06:17:41 user nova-compute[71711]:     <disk supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='diskDevice'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>disk</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cdrom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>floppy</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>lun</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='bus'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>ide</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>fdc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sata</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </disk>
Apr 12 06:17:41 user nova-compute[71711]:     <graphics supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sdl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vnc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>spice</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egl-headless</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </graphics>
Apr 12 06:17:41 user nova-compute[71711]:     <video supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='modelType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cirrus</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vmvga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>qxl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>none</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>bochs</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>ramfb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </video>
Apr 12 06:17:41 user nova-compute[71711]:     <hostdev supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='mode'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>subsystem</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='startupPolicy'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>default</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>mandatory</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>requisite</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>optional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='subsysType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pci</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='capsType'/>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='pciBackend'/>
Apr 12 06:17:41 user nova-compute[71711]:     </hostdev>
Apr 12 06:17:41 user nova-compute[71711]:     <rng supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>random</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egd</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>builtin</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </rng>
Apr 12 06:17:41 user nova-compute[71711]:     <filesystem supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='driverType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>path</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>handle</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtiofs</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </filesystem>
Apr 12 06:17:41 user nova-compute[71711]:     <tpm supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-tis</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-crb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>passthrough</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>emulator</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </tpm>
Apr 12 06:17:41 user nova-compute[71711]:   </devices>
Apr 12 06:17:41 user nova-compute[71711]:   <features>
Apr 12 06:17:41 user nova-compute[71711]:     <gic supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     <vmcoreinfo supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <genid supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backingStoreInput supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backup supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <sev supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:   </features>
Apr 12 06:17:41 user nova-compute[71711]: </domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:  {{(pid=71711) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 12 06:17:41 user nova-compute[71711]: <domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 06:17:41 user nova-compute[71711]:   <domain>kvm</domain>
Apr 12 06:17:41 user nova-compute[71711]:   <machine>pc-q35-6.2</machine>
Apr 12 06:17:41 user nova-compute[71711]:   <arch>x86_64</arch>
Apr 12 06:17:41 user nova-compute[71711]:   <vcpu max='288'/>
Apr 12 06:17:41 user nova-compute[71711]:   <iothreads supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:   <os supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='firmware'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>efi</value>
Apr 12 06:17:41 user nova-compute[71711]:     </enum>
Apr 12 06:17:41 user nova-compute[71711]:     <loader supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>rom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pflash</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='readonly'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>yes</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='secure'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>yes</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </loader>
Apr 12 06:17:41 user nova-compute[71711]:   </os>
Apr 12 06:17:41 user nova-compute[71711]:   <cpu>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-passthrough' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='hostPassthroughMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>on</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='maximum' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='maximumMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>on</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-model' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <vendor>Intel</vendor>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ss'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='vmx'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='pcid'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='hypervisor'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arat'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='umip'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='md-clear'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='invtsc'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibpb'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibrs'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='rsba'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='erms'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='custom' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>qemu64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>qemu32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>phenom</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>n270</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>kvm64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>kvm32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>coreduo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>core2duo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>athlon</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Westmere</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Snowridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Penryn</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G5</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G4</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Opteron_G1</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Nehalem</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Rome</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Milan</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Dhyana</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cooperlake</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Conroe</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>486</model>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:   </cpu>
Apr 12 06:17:41 user nova-compute[71711]:   <memoryBacking supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='sourceType'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>file</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>anonymous</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>memfd</value>
Apr 12 06:17:41 user nova-compute[71711]:     </enum>
Apr 12 06:17:41 user nova-compute[71711]:   </memoryBacking>
Apr 12 06:17:41 user nova-compute[71711]:   <devices>
Apr 12 06:17:41 user nova-compute[71711]:     <disk supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='diskDevice'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>disk</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cdrom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>floppy</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>lun</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='bus'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>fdc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sata</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </disk>
Apr 12 06:17:41 user nova-compute[71711]:     <graphics supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sdl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vnc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>spice</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egl-headless</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </graphics>
Apr 12 06:17:41 user nova-compute[71711]:     <video supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='modelType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cirrus</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vmvga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>qxl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>none</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>bochs</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>ramfb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </video>
Apr 12 06:17:41 user nova-compute[71711]:     <hostdev supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='mode'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>subsystem</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='startupPolicy'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>default</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>mandatory</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>requisite</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>optional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='subsysType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pci</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='capsType'/>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='pciBackend'/>
Apr 12 06:17:41 user nova-compute[71711]:     </hostdev>
Apr 12 06:17:41 user nova-compute[71711]:     <rng supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>random</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egd</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>builtin</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </rng>
Apr 12 06:17:41 user nova-compute[71711]:     <filesystem supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='driverType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>path</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>handle</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtiofs</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </filesystem>
Apr 12 06:17:41 user nova-compute[71711]:     <tpm supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-tis</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-crb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>passthrough</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>emulator</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </tpm>
Apr 12 06:17:41 user nova-compute[71711]:   </devices>
Apr 12 06:17:41 user nova-compute[71711]:   <features>
Apr 12 06:17:41 user nova-compute[71711]:     <gic supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     <vmcoreinfo supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <genid supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backingStoreInput supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backup supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <sev supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:   </features>
Apr 12 06:17:41 user nova-compute[71711]: </domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:  {{(pid=71711) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 12 06:17:41 user nova-compute[71711]: <domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 06:17:41 user nova-compute[71711]:   <domain>kvm</domain>
Apr 12 06:17:41 user nova-compute[71711]:   <machine>pc-q35-jammy</machine>
Apr 12 06:17:41 user nova-compute[71711]:   <arch>x86_64</arch>
Apr 12 06:17:41 user nova-compute[71711]:   <vcpu max='288'/>
Apr 12 06:17:41 user nova-compute[71711]:   <iothreads supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:   <os supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='firmware'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>efi</value>
Apr 12 06:17:41 user nova-compute[71711]:     </enum>
Apr 12 06:17:41 user nova-compute[71711]:     <loader supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>rom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pflash</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='readonly'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>yes</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='secure'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>yes</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>no</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </loader>
Apr 12 06:17:41 user nova-compute[71711]:   </os>
Apr 12 06:17:41 user nova-compute[71711]:   <cpu>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-passthrough' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='hostPassthroughMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>on</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='maximum' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='maximumMigratable'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>on</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>off</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='host-model' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <vendor>Intel</vendor>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ss'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='vmx'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='pcid'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='hypervisor'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arat'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='umip'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='md-clear'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='invtsc'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibpb'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='ibrs'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-stibp'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='rsba'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='erms'/>
Apr 12 06:17:41 user nova-compute[71711]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:     <mode name='custom' supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>qemu64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>qemu32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>phenom</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>pentium</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>n270</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>kvm64</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>kvm32</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>coreduo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>core2duo</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>athlon</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Westmere</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Snowridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Skylake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>SandyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Penryn</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G5</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G4</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G3</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Opteron_G2</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Opteron_G1</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Nehalem</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>IvyBridge</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Icelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Haswell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Rome</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-Milan</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>EPYC</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Dhyana</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cooperlake</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>Conroe</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='no'>Broadwell</model>
Apr 12 06:17:41 user nova-compute[71711]:       <model usable='yes'>486</model>
Apr 12 06:17:41 user nova-compute[71711]:     </mode>
Apr 12 06:17:41 user nova-compute[71711]:   </cpu>
Apr 12 06:17:41 user nova-compute[71711]:   <memoryBacking supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:     <enum name='sourceType'>
Apr 12 06:17:41 user nova-compute[71711]:       <value>file</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>anonymous</value>
Apr 12 06:17:41 user nova-compute[71711]:       <value>memfd</value>
Apr 12 06:17:41 user nova-compute[71711]:     </enum>
Apr 12 06:17:41 user nova-compute[71711]:   </memoryBacking>
Apr 12 06:17:41 user nova-compute[71711]:   <devices>
Apr 12 06:17:41 user nova-compute[71711]:     <disk supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='diskDevice'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>disk</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cdrom</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>floppy</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>lun</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='bus'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>fdc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sata</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </disk>
Apr 12 06:17:41 user nova-compute[71711]:     <graphics supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='type'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>sdl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vnc</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>spice</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egl-headless</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </graphics>
Apr 12 06:17:41 user nova-compute[71711]:     <video supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='modelType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>cirrus</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>vmvga</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>qxl</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>none</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>bochs</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>ramfb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </video>
Apr 12 06:17:41 user nova-compute[71711]:     <hostdev supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='mode'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>subsystem</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='startupPolicy'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>default</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>mandatory</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>requisite</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>optional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='subsysType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>usb</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>pci</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>scsi</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='capsType'/>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='pciBackend'/>
Apr 12 06:17:41 user nova-compute[71711]:     </hostdev>
Apr 12 06:17:41 user nova-compute[71711]:     <rng supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtio-non-transitional</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>random</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>egd</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>builtin</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </rng>
Apr 12 06:17:41 user nova-compute[71711]:     <filesystem supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='driverType'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>path</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>handle</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>virtiofs</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </filesystem>
Apr 12 06:17:41 user nova-compute[71711]:     <tpm supported='yes'>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='model'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-tis</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>tpm-crb</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:       <enum name='backendModel'>
Apr 12 06:17:41 user nova-compute[71711]:         <value>passthrough</value>
Apr 12 06:17:41 user nova-compute[71711]:         <value>emulator</value>
Apr 12 06:17:41 user nova-compute[71711]:       </enum>
Apr 12 06:17:41 user nova-compute[71711]:     </tpm>
Apr 12 06:17:41 user nova-compute[71711]:   </devices>
Apr 12 06:17:41 user nova-compute[71711]:   <features>
Apr 12 06:17:41 user nova-compute[71711]:     <gic supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:     <vmcoreinfo supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <genid supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backingStoreInput supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <backup supported='yes'/>
Apr 12 06:17:41 user nova-compute[71711]:     <sev supported='no'/>
Apr 12 06:17:41 user nova-compute[71711]:   </features>
Apr 12 06:17:41 user nova-compute[71711]: </domainCapabilities>
Apr 12 06:17:41 user nova-compute[71711]:  {{(pid=71711) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71711) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71711) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Checking secure boot support for host arch (x86_64) {{(pid=71711) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Checking secure boot support for host arch (x86_64) {{(pid=71711) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Checking secure boot support for host arch (x86_64) {{(pid=71711) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Checking secure boot support for host arch (x86_64) {{(pid=71711) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Checking secure boot support for host arch (x86_64) {{(pid=71711) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 06:17:41 user nova-compute[71711]: INFO nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Secure Boot support detected
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] cpu compare xml: <cpu match="exact">
Apr 12 06:17:41 user nova-compute[71711]:   <model>Nehalem</model>
Apr 12 06:17:41 user nova-compute[71711]: </cpu>
Apr 12 06:17:41 user nova-compute[71711]:  {{(pid=71711) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 12 06:17:41 user nova-compute[71711]: INFO nova.virt.node [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Generated node identity 1e1b2f58-6c32-4311-9037-c28244d485c6
Apr 12 06:17:41 user nova-compute[71711]: INFO nova.virt.node [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Wrote node identity 1e1b2f58-6c32-4311-9037-c28244d485c6 to /opt/stack/data/nova/compute_id
Apr 12 06:17:41 user nova-compute[71711]: WARNING nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Compute nodes ['1e1b2f58-6c32-4311-9037-c28244d485c6'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 12 06:17:41 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 12 06:17:41 user nova-compute[71711]: WARNING nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 06:17:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:17:41 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:17:42 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:17:42 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Hypervisor/Node resource view: name=user free_ram=10887MB free_disk=27.034156799316406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:17:42 user nova-compute[71711]: WARNING nova.compute.resource_tracker [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] No compute node record for user:1e1b2f58-6c32-4311-9037-c28244d485c6: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 1e1b2f58-6c32-4311-9037-c28244d485c6 could not be found.
Apr 12 06:17:42 user nova-compute[71711]: INFO nova.compute.resource_tracker [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Compute node record created for user:user with uuid: 1e1b2f58-6c32-4311-9037-c28244d485c6
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:17:42 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [req-48b8bc65-5f6b-4a97-859a-f94021bef88e] Created resource provider record via placement API for resource provider with UUID 1e1b2f58-6c32-4311-9037-c28244d485c6 and name user.
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71711) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 12 06:17:42 user nova-compute[71711]: INFO nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] kernel doesn't support AMD SEV
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Updating inventory in ProviderTree for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Libvirt baseline CPU <cpu>
Apr 12 06:17:42 user nova-compute[71711]:   <arch>x86_64</arch>
Apr 12 06:17:42 user nova-compute[71711]:   <model>Nehalem</model>
Apr 12 06:17:42 user nova-compute[71711]:   <vendor>Intel</vendor>
Apr 12 06:17:42 user nova-compute[71711]:   <topology sockets="6" cores="1" threads="1"/>
Apr 12 06:17:42 user nova-compute[71711]: </cpu>
Apr 12 06:17:42 user nova-compute[71711]:  {{(pid=71711) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Updated inventory for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Updating resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6 generation from 0 to 1 during operation: update_inventory {{(pid=71711) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Updating inventory in ProviderTree for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Updating resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6 generation from 1 to 2 during operation: update_traits {{(pid=71711) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.service [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Creating RPC server for service compute {{(pid=71711) start /opt/stack/nova/nova/service.py:182}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.service [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Join ServiceGroup membership for this service compute {{(pid=71711) start /opt/stack/nova/nova/service.py:199}}
Apr 12 06:17:42 user nova-compute[71711]: DEBUG nova.servicegroup.drivers.db [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71711) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 12 06:18:18 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:18:18 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:18:34 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:18:34 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:18:34 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=10198MB free_disk=26.947948455810547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:18:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:19:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:19:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:19:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:19:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:19:35 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:19:35 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:19:35 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=10186MB free_disk=26.9915771484375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:19:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:19:36 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:19:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:19:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:19:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 06:19:36 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:19:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:20:35 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:20:36 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:20:36 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:20:36 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=10199MB free_disk=26.77002716064453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:20:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:20:37 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:20:37 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:20:37 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:20:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:21:36 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:21:36 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:21:36 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:21:37 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:21:37 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:21:37 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:21:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:21:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "46b32f3f-86c4-450a-a710-7d0c05ea4097" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:21:38 user nova-compute[71711]: INFO nova.compute.claims [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Claim successful on node user
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.249s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:21:38 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:21:38 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=9396MB free_disk=26.791114807128906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:38 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:21:38 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:21:39 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Creating image(s)
Apr 12 06:21:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "/opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "/opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "/opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83.part --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG nova.policy [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e761442395d14d7f82216e3d4174e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbca90b5b5fb49ca857aa4e215a99e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83.part --force-share --output=json" returned: 0 in 0.159s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG nova.virt.images [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] 4f2549ed-915f-4494-87f3-9269834fa9da was qcow2, converting to raw {{(pid=71711) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:21:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83.part /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83.converted {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83.part /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83.converted" returned: 0 in 0.154s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83.converted --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.966s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:40 user nova-compute[71711]: INFO oslo.privsep.daemon [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_p086ip9/privsep.sock']
Apr 12 06:21:40 user sudo[80416]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_p086ip9/privsep.sock
Apr 12 06:21:40 user sudo[80416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:21:41 user sudo[80416]: pam_unix(sudo:session): session closed for user root
Apr 12 06:21:41 user nova-compute[71711]: INFO oslo.privsep.daemon [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Spawned new privsep daemon via rootwrap
Apr 12 06:21:41 user nova-compute[71711]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 06:21:41 user nova-compute[71711]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 06:21:41 user nova-compute[71711]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 12 06:21:41 user nova-compute[71711]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80422
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.158s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.151s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk 1073741824" returned: 0 in 0.045s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.155s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Cannot resize image /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lazy-loading 'migration_context' on Instance uuid 46b32f3f-86c4-450a-a710-7d0c05ea4097 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Ensure instance console log exists: /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:43 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Successfully created port: 33f085d7-b843-4c48-8379-a5c2690a4231 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:21:46 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Successfully updated port: 33f085d7-b843-4c48-8379-a5c2690a4231 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:21:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "refresh_cache-46b32f3f-86c4-450a-a710-7d0c05ea4097" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:21:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquired lock "refresh_cache-46b32f3f-86c4-450a-a710-7d0c05ea4097" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:21:46 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:21:46 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:21:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Received event network-changed-33f085d7-b843-4c48-8379-a5c2690a4231 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:21:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Refreshing instance network info cache due to event network-changed-33f085d7-b843-4c48-8379-a5c2690a4231. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:21:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] Acquiring lock "refresh_cache-46b32f3f-86c4-450a-a710-7d0c05ea4097" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Updating instance_info_cache with network_info: [{"id": "33f085d7-b843-4c48-8379-a5c2690a4231", "address": "fa:16:3e:4e:28:c3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f085d7-b8", "ovs_interfaceid": "33f085d7-b843-4c48-8379-a5c2690a4231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Releasing lock "refresh_cache-46b32f3f-86c4-450a-a710-7d0c05ea4097" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Instance network_info: |[{"id": "33f085d7-b843-4c48-8379-a5c2690a4231", "address": "fa:16:3e:4e:28:c3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f085d7-b8", "ovs_interfaceid": "33f085d7-b843-4c48-8379-a5c2690a4231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] Acquired lock "refresh_cache-46b32f3f-86c4-450a-a710-7d0c05ea4097" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.network.neutron [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Refreshing network info cache for port 33f085d7-b843-4c48-8379-a5c2690a4231 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Start _get_guest_xml network_info=[{"id": "33f085d7-b843-4c48-8379-a5c2690a4231", "address": "fa:16:3e:4e:28:c3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f085d7-b8", "ovs_interfaceid": "33f085d7-b843-4c48-8379-a5c2690a4231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:21:47 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:21:47 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2118576466',display_name='tempest-ServersNegativeTestJSON-server-2118576466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2118576466',id=1,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbca90b5b5fb49ca857aa4e215a99e37',ramdisk_id='',reservation_id='r-gpn11dzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-815999574',owner_user_name='tempest-ServersNegativeTestJSON-815999574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:21:39Z,user_data=None,user_id='e761442395d14d7f82216e3d4174e43a',uuid=46b32f3f-86c4-450a-a710-7d0c05ea4097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33f085d7-b843-4c48-8379-a5c2690a4231", "address": "fa:16:3e:4e:28:c3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f085d7-b8", "ovs_interfaceid": "33f085d7-b843-4c48-8379-a5c2690a4231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Converting VIF {"id": "33f085d7-b843-4c48-8379-a5c2690a4231", "address": "fa:16:3e:4e:28:c3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f085d7-b8", "ovs_interfaceid": "33f085d7-b843-4c48-8379-a5c2690a4231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:28:c3,bridge_name='br-int',has_traffic_filtering=True,id=33f085d7-b843-4c48-8379-a5c2690a4231,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f085d7-b8') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.objects.instance [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lazy-loading 'pci_devices' on Instance uuid 46b32f3f-86c4-450a-a710-7d0c05ea4097 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:21:47 user nova-compute[71711]:   <uuid>46b32f3f-86c4-450a-a710-7d0c05ea4097</uuid>
Apr 12 06:21:47 user nova-compute[71711]:   <name>instance-00000001</name>
Apr 12 06:21:47 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:21:47 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:21:47 user nova-compute[71711]:   <metadata>
Apr 12 06:21:47 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:21:47 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:21:47 user nova-compute[71711]:       <nova:name>tempest-ServersNegativeTestJSON-server-2118576466</nova:name>
Apr 12 06:21:47 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:21:47</nova:creationTime>
Apr 12 06:21:47 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:21:47 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:21:47 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:21:47 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:21:47 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:21:47 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:21:47 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:21:47 user nova-compute[71711]:       <nova:owner>
Apr 12 06:21:47 user nova-compute[71711]:         <nova:user uuid="e761442395d14d7f82216e3d4174e43a">tempest-ServersNegativeTestJSON-815999574-project-member</nova:user>
Apr 12 06:21:47 user nova-compute[71711]:         <nova:project uuid="fbca90b5b5fb49ca857aa4e215a99e37">tempest-ServersNegativeTestJSON-815999574</nova:project>
Apr 12 06:21:47 user nova-compute[71711]:       </nova:owner>
Apr 12 06:21:47 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:21:47 user nova-compute[71711]:       <nova:ports>
Apr 12 06:21:47 user nova-compute[71711]:         <nova:port uuid="33f085d7-b843-4c48-8379-a5c2690a4231">
Apr 12 06:21:47 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:21:47 user nova-compute[71711]:         </nova:port>
Apr 12 06:21:47 user nova-compute[71711]:       </nova:ports>
Apr 12 06:21:47 user nova-compute[71711]:     </nova:instance>
Apr 12 06:21:47 user nova-compute[71711]:   </metadata>
Apr 12 06:21:47 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:21:47 user nova-compute[71711]:     <system>
Apr 12 06:21:47 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:21:47 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:21:47 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:21:47 user nova-compute[71711]:       <entry name="serial">46b32f3f-86c4-450a-a710-7d0c05ea4097</entry>
Apr 12 06:21:47 user nova-compute[71711]:       <entry name="uuid">46b32f3f-86c4-450a-a710-7d0c05ea4097</entry>
Apr 12 06:21:47 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:21:47 user nova-compute[71711]:     </system>
Apr 12 06:21:47 user nova-compute[71711]:   </sysinfo>
Apr 12 06:21:47 user nova-compute[71711]:   <os>
Apr 12 06:21:47 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:21:47 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:21:47 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:21:47 user nova-compute[71711]:   </os>
Apr 12 06:21:47 user nova-compute[71711]:   <features>
Apr 12 06:21:47 user nova-compute[71711]:     <acpi/>
Apr 12 06:21:47 user nova-compute[71711]:     <apic/>
Apr 12 06:21:47 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:21:47 user nova-compute[71711]:   </features>
Apr 12 06:21:47 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:21:47 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:21:47 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:21:47 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:21:47 user nova-compute[71711]:   </clock>
Apr 12 06:21:47 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:21:47 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:21:47 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:21:47 user nova-compute[71711]:   </cpu>
Apr 12 06:21:47 user nova-compute[71711]:   <devices>
Apr 12 06:21:47 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:21:47 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:21:47 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk"/>
Apr 12 06:21:47 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:21:47 user nova-compute[71711]:     </disk>
Apr 12 06:21:47 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:21:47 user nova-compute[71711]:       <mac address="fa:16:3e:4e:28:c3"/>
Apr 12 06:21:47 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:21:47 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:21:47 user nova-compute[71711]:       <target dev="tap33f085d7-b8"/>
Apr 12 06:21:47 user nova-compute[71711]:     </interface>
Apr 12 06:21:47 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:21:47 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/console.log" append="off"/>
Apr 12 06:21:47 user nova-compute[71711]:     </serial>
Apr 12 06:21:47 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:21:47 user nova-compute[71711]:     <video>
Apr 12 06:21:47 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:21:47 user nova-compute[71711]:     </video>
Apr 12 06:21:47 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:21:47 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:21:47 user nova-compute[71711]:     </rng>
Apr 12 06:21:47 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:21:47 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:21:47 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:21:47 user nova-compute[71711]:     </memballoon>
Apr 12 06:21:47 user nova-compute[71711]:   </devices>
Apr 12 06:21:47 user nova-compute[71711]: </domain>
Apr 12 06:21:47 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2118576466',display_name='tempest-ServersNegativeTestJSON-server-2118576466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2118576466',id=1,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbca90b5b5fb49ca857aa4e215a99e37',ramdisk_id='',reservation_id='r-gpn11dzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-815999574',owner_user_name='tempest-ServersNegativeTestJSON-815999574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:21:39Z,user_data=None,user_id='e761442395d14d7f82216e3d4174e43a',uuid=46b32f3f-86c4-450a-a710-7d0c05ea4097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33f085d7-b843-4c48-8379-a5c2690a4231", "address": "fa:16:3e:4e:28:c3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f085d7-b8", "ovs_interfaceid": "33f085d7-b843-4c48-8379-a5c2690a4231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Converting VIF {"id": "33f085d7-b843-4c48-8379-a5c2690a4231", "address": "fa:16:3e:4e:28:c3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f085d7-b8", "ovs_interfaceid": "33f085d7-b843-4c48-8379-a5c2690a4231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:28:c3,bridge_name='br-int',has_traffic_filtering=True,id=33f085d7-b843-4c48-8379-a5c2690a4231,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f085d7-b8') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG os_vif [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:28:c3,bridge_name='br-int',has_traffic_filtering=True,id=33f085d7-b843-4c48-8379-a5c2690a4231,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f085d7-b8') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Created schema index Interface.name {{(pid=71711) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Created schema index Port.name {{(pid=71711) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Created schema index Bridge.name {{(pid=71711) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [POLLOUT] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:21:47 user nova-compute[71711]: INFO oslo.privsep.daemon [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpbav8uqym/privsep.sock']
Apr 12 06:21:47 user sudo[80450]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpbav8uqym/privsep.sock
Apr 12 06:21:47 user sudo[80450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:21:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.compute.manager [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:47 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:21:47 user nova-compute[71711]: INFO nova.compute.claims [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Claim successful on node user
Apr 12 06:21:48 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG nova.network.neutron [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:21:48 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:21:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG nova.policy [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:21:48 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Creating image(s)
Apr 12 06:21:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "/opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "/opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "/opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.172s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.184s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk 1073741824" returned: 0 in 0.074s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.network.neutron [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Updated VIF entry in instance network info cache for port 33f085d7-b843-4c48-8379-a5c2690a4231. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.network.neutron [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Updating instance_info_cache with network_info: [{"id": "33f085d7-b843-4c48-8379-a5c2690a4231", "address": "fa:16:3e:4e:28:c3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f085d7-b8", "ovs_interfaceid": "33f085d7-b843-4c48-8379-a5c2690a4231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-699c9d98-179e-4b8a-93eb-6e826317bb17 req-498617e4-9a03-4cc7-b77c-0cfd015f131f service nova] Releasing lock "refresh_cache-46b32f3f-86c4-450a-a710-7d0c05ea4097" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.157s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "149703ba-0e5a-46f3-b988-d864de1c2137" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "149703ba-0e5a-46f3-b988-d864de1c2137" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Cannot resize image /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.objects.instance [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'migration_context' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Ensure instance console log exists: /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:21:49 user nova-compute[71711]: INFO nova.compute.claims [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Claim successful on node user
Apr 12 06:21:49 user sudo[80450]: pam_unix(sudo:session): session closed for user root
Apr 12 06:21:49 user nova-compute[71711]: INFO oslo.privsep.daemon [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Spawned new privsep daemon via rootwrap
Apr 12 06:21:49 user nova-compute[71711]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 06:21:49 user nova-compute[71711]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 06:21:49 user nova-compute[71711]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 12 06:21:49 user nova-compute[71711]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80476
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:21:49 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:21:50 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:21:50 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:21:50 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Creating image(s)
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "/opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "/opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "/opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33f085d7-b8, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33f085d7-b8, col_values=(('external_ids', {'iface-id': '33f085d7-b843-4c48-8379-a5c2690a4231', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:28:c3', 'vm-uuid': '46b32f3f-86c4-450a-a710-7d0c05ea4097'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:50 user nova-compute[71711]: INFO os_vif [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:28:c3,bridge_name='br-int',has_traffic_filtering=True,id=33f085d7-b843-4c48-8379-a5c2690a4231,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f085d7-b8')
Apr 12 06:21:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] No VIF found with MAC fa:16:3e:4e:28:c3, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG nova.policy [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee2e2b19e9dd4d578a38e1ddec680b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e474b11e55eb45ff91f140aae7e2981d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.164s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk 1073741824" returned: 0 in 0.064s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.179s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG nova.network.neutron [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Successfully created port: 1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Cannot resize image /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lazy-loading 'migration_context' on Instance uuid 149703ba-0e5a-46f3-b988-d864de1c2137 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Ensure instance console log exists: /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:52 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Successfully created port: 9c356d39-d585-49ef-82de-d123a1d5e0d6 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:21:52 user nova-compute[71711]: DEBUG nova.network.neutron [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Successfully updated port: 1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:21:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:21:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquired lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:21:52 user nova-compute[71711]: DEBUG nova.network.neutron [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:21:52 user nova-compute[71711]: DEBUG nova.network.neutron [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280513.359499, 46b32f3f-86c4-450a-a710-7d0c05ea4097 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:21:53 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] VM Resumed (Lifecycle Event)
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:21:53 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Instance spawned successfully.
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-64098887-5398-4e94-a51a-ff802359ae3d req-5e1820c9-985b-4e13-b297-d33f1130cb50 service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Received event network-vif-plugged-33f085d7-b843-4c48-8379-a5c2690a4231 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-64098887-5398-4e94-a51a-ff802359ae3d req-5e1820c9-985b-4e13-b297-d33f1130cb50 service nova] Acquiring lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-64098887-5398-4e94-a51a-ff802359ae3d req-5e1820c9-985b-4e13-b297-d33f1130cb50 service nova] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-64098887-5398-4e94-a51a-ff802359ae3d req-5e1820c9-985b-4e13-b297-d33f1130cb50 service nova] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-64098887-5398-4e94-a51a-ff802359ae3d req-5e1820c9-985b-4e13-b297-d33f1130cb50 service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] No waiting events found dispatching network-vif-plugged-33f085d7-b843-4c48-8379-a5c2690a4231 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:21:53 user nova-compute[71711]: WARNING nova.compute.manager [req-64098887-5398-4e94-a51a-ff802359ae3d req-5e1820c9-985b-4e13-b297-d33f1130cb50 service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Received unexpected event network-vif-plugged-33f085d7-b843-4c48-8379-a5c2690a4231 for instance with vm_state building and task_state spawning.
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-changed-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Refreshing instance network info cache due to event network-changed-1e69d862-c01c-48c7-8795-00233f9e7812. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] Acquiring lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:21:53 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280513.3607392, 46b32f3f-86c4-450a-a710-7d0c05ea4097 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:21:53 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] VM Started (Lifecycle Event)
Apr 12 06:21:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:53 user nova-compute[71711]: INFO nova.compute.manager [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Took 14.40 seconds to spawn the instance on the hypervisor.
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:21:53 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:21:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:21:53 user nova-compute[71711]: INFO nova.compute.claims [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Claim successful on node user
Apr 12 06:21:53 user nova-compute[71711]: INFO nova.compute.manager [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Took 15.80 seconds to build instance.
Apr 12 06:21:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b8f1ccd5-9450-4dfe-9f81-3470ff95bca9 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.068s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.network.neutron [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updating instance_info_cache with network_info: [{"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Releasing lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Instance network_info: |[{"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] Acquired lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.network.neutron [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Refreshing network info cache for port 1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Start _get_guest_xml network_info=[{"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:21:53 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:21:53 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:21:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-347561886',display_name='tempest-AttachVolumeTestJSON-server-347561886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-347561886',id=2,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwrNegtuUQxlGPyN3pFJ5X6ve+WFpWa8ZN5z88plFcMC7jAP25D92PakJ6yQbAkk2nQ1OF8Me+pJecej1aLutIgKjYku+yi3zY9Z7mDtSHYPVUZwc5/VPOAX8HIWorUMg==',key_name='tempest-keypair-673948167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f124d62c4d345d9af22f1557abca276',ramdisk_id='',reservation_id='r-l92zv936',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1680327736',owner_user_name='tempest-AttachVolumeTestJSON-1680327736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:21:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d58cc232d0094bebacf147c6b61a0989',uuid=7dee97a4-9497-43c2-a688-7bedd1441885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converting VIF {"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.objects.instance [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'pci_devices' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:21:54 user nova-compute[71711]:   <uuid>7dee97a4-9497-43c2-a688-7bedd1441885</uuid>
Apr 12 06:21:54 user nova-compute[71711]:   <name>instance-00000002</name>
Apr 12 06:21:54 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:21:54 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:21:54 user nova-compute[71711]:   <metadata>
Apr 12 06:21:54 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:21:54 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:21:54 user nova-compute[71711]:       <nova:name>tempest-AttachVolumeTestJSON-server-347561886</nova:name>
Apr 12 06:21:54 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:21:53</nova:creationTime>
Apr 12 06:21:54 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:21:54 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:21:54 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:21:54 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:21:54 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:21:54 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:21:54 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:21:54 user nova-compute[71711]:       <nova:owner>
Apr 12 06:21:54 user nova-compute[71711]:         <nova:user uuid="d58cc232d0094bebacf147c6b61a0989">tempest-AttachVolumeTestJSON-1680327736-project-member</nova:user>
Apr 12 06:21:54 user nova-compute[71711]:         <nova:project uuid="4f124d62c4d345d9af22f1557abca276">tempest-AttachVolumeTestJSON-1680327736</nova:project>
Apr 12 06:21:54 user nova-compute[71711]:       </nova:owner>
Apr 12 06:21:54 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:21:54 user nova-compute[71711]:       <nova:ports>
Apr 12 06:21:54 user nova-compute[71711]:         <nova:port uuid="1e69d862-c01c-48c7-8795-00233f9e7812">
Apr 12 06:21:54 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 06:21:54 user nova-compute[71711]:         </nova:port>
Apr 12 06:21:54 user nova-compute[71711]:       </nova:ports>
Apr 12 06:21:54 user nova-compute[71711]:     </nova:instance>
Apr 12 06:21:54 user nova-compute[71711]:   </metadata>
Apr 12 06:21:54 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:21:54 user nova-compute[71711]:     <system>
Apr 12 06:21:54 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:21:54 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:21:54 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:21:54 user nova-compute[71711]:       <entry name="serial">7dee97a4-9497-43c2-a688-7bedd1441885</entry>
Apr 12 06:21:54 user nova-compute[71711]:       <entry name="uuid">7dee97a4-9497-43c2-a688-7bedd1441885</entry>
Apr 12 06:21:54 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:21:54 user nova-compute[71711]:     </system>
Apr 12 06:21:54 user nova-compute[71711]:   </sysinfo>
Apr 12 06:21:54 user nova-compute[71711]:   <os>
Apr 12 06:21:54 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:21:54 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:21:54 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:21:54 user nova-compute[71711]:   </os>
Apr 12 06:21:54 user nova-compute[71711]:   <features>
Apr 12 06:21:54 user nova-compute[71711]:     <acpi/>
Apr 12 06:21:54 user nova-compute[71711]:     <apic/>
Apr 12 06:21:54 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:21:54 user nova-compute[71711]:   </features>
Apr 12 06:21:54 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:21:54 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:21:54 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:21:54 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:21:54 user nova-compute[71711]:   </clock>
Apr 12 06:21:54 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:21:54 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:21:54 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:21:54 user nova-compute[71711]:   </cpu>
Apr 12 06:21:54 user nova-compute[71711]:   <devices>
Apr 12 06:21:54 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:21:54 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:21:54 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk"/>
Apr 12 06:21:54 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:21:54 user nova-compute[71711]:     </disk>
Apr 12 06:21:54 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:21:54 user nova-compute[71711]:       <mac address="fa:16:3e:4c:89:31"/>
Apr 12 06:21:54 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:21:54 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:21:54 user nova-compute[71711]:       <target dev="tap1e69d862-c0"/>
Apr 12 06:21:54 user nova-compute[71711]:     </interface>
Apr 12 06:21:54 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:21:54 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/console.log" append="off"/>
Apr 12 06:21:54 user nova-compute[71711]:     </serial>
Apr 12 06:21:54 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:21:54 user nova-compute[71711]:     <video>
Apr 12 06:21:54 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:21:54 user nova-compute[71711]:     </video>
Apr 12 06:21:54 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:21:54 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:21:54 user nova-compute[71711]:     </rng>
Apr 12 06:21:54 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:21:54 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:21:54 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:21:54 user nova-compute[71711]:     </memballoon>
Apr 12 06:21:54 user nova-compute[71711]:   </devices>
Apr 12 06:21:54 user nova-compute[71711]: </domain>
Apr 12 06:21:54 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-347561886',display_name='tempest-AttachVolumeTestJSON-server-347561886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-347561886',id=2,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwrNegtuUQxlGPyN3pFJ5X6ve+WFpWa8ZN5z88plFcMC7jAP25D92PakJ6yQbAkk2nQ1OF8Me+pJecej1aLutIgKjYku+yi3zY9Z7mDtSHYPVUZwc5/VPOAX8HIWorUMg==',key_name='tempest-keypair-673948167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f124d62c4d345d9af22f1557abca276',ramdisk_id='',reservation_id='r-l92zv936',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1680327736',owner_user_name='tempest-AttachVolumeTestJSON-1680327736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:21:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d58cc232d0094bebacf147c6b61a0989',uuid=7dee97a4-9497-43c2-a688-7bedd1441885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converting VIF {"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG os_vif [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e69d862-c0, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e69d862-c0, col_values=(('external_ids', {'iface-id': '1e69d862-c01c-48c7-8795-00233f9e7812', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:89:31', 'vm-uuid': '7dee97a4-9497-43c2-a688-7bedd1441885'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:54 user nova-compute[71711]: INFO os_vif [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0')
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No VIF found with MAC fa:16:3e:4c:89:31, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:21:54 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:21:54 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Creating image(s)
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Successfully updated port: 9c356d39-d585-49ef-82de-d123a1d5e0d6 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "refresh_cache-149703ba-0e5a-46f3-b988-d864de1c2137" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquired lock "refresh_cache-149703ba-0e5a-46f3-b988-d864de1c2137" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.179s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.policy [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Received event network-changed-9c356d39-d585-49ef-82de-d123a1d5e0d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Refreshing instance network info cache due to event network-changed-9c356d39-d585-49ef-82de-d123a1d5e0d6. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] Acquiring lock "refresh_cache-149703ba-0e5a-46f3-b988-d864de1c2137" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.187s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk 1073741824" returned: 0 in 0.060s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.164s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Cannot resize image /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'migration_context' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Ensure instance console log exists: /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG nova.network.neutron [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updated VIF entry in instance network info cache for port 1e69d862-c01c-48c7-8795-00233f9e7812. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG nova.network.neutron [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updating instance_info_cache with network_info: [{"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-65351225-4208-4bd4-b3cb-09937869923f req-1ebf9de5-577b-4fbf-8916-220b4ef4b082 service nova] Releasing lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-445d4573-81cf-44d5-bb19-c2036931e397 req-c377af30-f8dc-4d98-b713-7a67af73b73d service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Received event network-vif-plugged-33f085d7-b843-4c48-8379-a5c2690a4231 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-445d4573-81cf-44d5-bb19-c2036931e397 req-c377af30-f8dc-4d98-b713-7a67af73b73d service nova] Acquiring lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-445d4573-81cf-44d5-bb19-c2036931e397 req-c377af30-f8dc-4d98-b713-7a67af73b73d service nova] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-445d4573-81cf-44d5-bb19-c2036931e397 req-c377af30-f8dc-4d98-b713-7a67af73b73d service nova] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-445d4573-81cf-44d5-bb19-c2036931e397 req-c377af30-f8dc-4d98-b713-7a67af73b73d service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] No waiting events found dispatching network-vif-plugged-33f085d7-b843-4c48-8379-a5c2690a4231 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:21:55 user nova-compute[71711]: WARNING nova.compute.manager [req-445d4573-81cf-44d5-bb19-c2036931e397 req-c377af30-f8dc-4d98-b713-7a67af73b73d service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Received unexpected event network-vif-plugged-33f085d7-b843-4c48-8379-a5c2690a4231 for instance with vm_state active and task_state None.
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-4c9d3d04-48e3-4e79-bb1d-df81269afef0 req-169e0c57-d113-44a5-abea-087be327b8b6 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4c9d3d04-48e3-4e79-bb1d-df81269afef0 req-169e0c57-d113-44a5-abea-087be327b8b6 service nova] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4c9d3d04-48e3-4e79-bb1d-df81269afef0 req-169e0c57-d113-44a5-abea-087be327b8b6 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4c9d3d04-48e3-4e79-bb1d-df81269afef0 req-169e0c57-d113-44a5-abea-087be327b8b6 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-4c9d3d04-48e3-4e79-bb1d-df81269afef0 req-169e0c57-d113-44a5-abea-087be327b8b6 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] No waiting events found dispatching network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:21:56 user nova-compute[71711]: WARNING nova.compute.manager [req-4c9d3d04-48e3-4e79-bb1d-df81269afef0 req-169e0c57-d113-44a5-abea-087be327b8b6 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received unexpected event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 for instance with vm_state building and task_state spawning.
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Updating instance_info_cache with network_info: [{"id": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "address": "fa:16:3e:7a:d2:3c", "network": {"id": "4f730b67-77d8-4694-9f2d-9c91555a540e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1684522379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e474b11e55eb45ff91f140aae7e2981d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c356d39-d5", "ovs_interfaceid": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Releasing lock "refresh_cache-149703ba-0e5a-46f3-b988-d864de1c2137" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Instance network_info: |[{"id": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "address": "fa:16:3e:7a:d2:3c", "network": {"id": "4f730b67-77d8-4694-9f2d-9c91555a540e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1684522379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e474b11e55eb45ff91f140aae7e2981d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c356d39-d5", "ovs_interfaceid": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] Acquired lock "refresh_cache-149703ba-0e5a-46f3-b988-d864de1c2137" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.network.neutron [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Refreshing network info cache for port 9c356d39-d585-49ef-82de-d123a1d5e0d6 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Start _get_guest_xml network_info=[{"id": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "address": "fa:16:3e:7a:d2:3c", "network": {"id": "4f730b67-77d8-4694-9f2d-9c91555a540e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1684522379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e474b11e55eb45ff91f140aae7e2981d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c356d39-d5", "ovs_interfaceid": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:21:56 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:21:56 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-61268901',display_name='tempest-DeleteServersTestJSON-server-61268901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-61268901',id=3,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e474b11e55eb45ff91f140aae7e2981d',ramdisk_id='',reservation_id='r-aogdq0lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1256853091',owner_user_name='tempest-DeleteServersTestJSON-1256853091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:21:50Z,user_data=None,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',uuid=149703ba-0e5a-46f3-b988-d864de1c2137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "address": "fa:16:3e:7a:d2:3c", "network": {"id": "4f730b67-77d8-4694-9f2d-9c91555a540e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1684522379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e474b11e55eb45ff91f140aae7e2981d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c356d39-d5", "ovs_interfaceid": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Converting VIF {"id": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "address": "fa:16:3e:7a:d2:3c", "network": {"id": "4f730b67-77d8-4694-9f2d-9c91555a540e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1684522379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e474b11e55eb45ff91f140aae7e2981d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c356d39-d5", "ovs_interfaceid": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:d2:3c,bridge_name='br-int',has_traffic_filtering=True,id=9c356d39-d585-49ef-82de-d123a1d5e0d6,network=Network(4f730b67-77d8-4694-9f2d-9c91555a540e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c356d39-d5') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lazy-loading 'pci_devices' on Instance uuid 149703ba-0e5a-46f3-b988-d864de1c2137 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:21:56 user nova-compute[71711]:   <uuid>149703ba-0e5a-46f3-b988-d864de1c2137</uuid>
Apr 12 06:21:56 user nova-compute[71711]:   <name>instance-00000003</name>
Apr 12 06:21:56 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:21:56 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:21:56 user nova-compute[71711]:   <metadata>
Apr 12 06:21:56 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:21:56 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:21:56 user nova-compute[71711]:       <nova:name>tempest-DeleteServersTestJSON-server-61268901</nova:name>
Apr 12 06:21:56 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:21:56</nova:creationTime>
Apr 12 06:21:56 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:21:56 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:21:56 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:21:56 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:21:56 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:21:56 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:21:56 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:21:56 user nova-compute[71711]:       <nova:owner>
Apr 12 06:21:56 user nova-compute[71711]:         <nova:user uuid="ee2e2b19e9dd4d578a38e1ddec680b5d">tempest-DeleteServersTestJSON-1256853091-project-member</nova:user>
Apr 12 06:21:56 user nova-compute[71711]:         <nova:project uuid="e474b11e55eb45ff91f140aae7e2981d">tempest-DeleteServersTestJSON-1256853091</nova:project>
Apr 12 06:21:56 user nova-compute[71711]:       </nova:owner>
Apr 12 06:21:56 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:21:56 user nova-compute[71711]:       <nova:ports>
Apr 12 06:21:56 user nova-compute[71711]:         <nova:port uuid="9c356d39-d585-49ef-82de-d123a1d5e0d6">
Apr 12 06:21:56 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 06:21:56 user nova-compute[71711]:         </nova:port>
Apr 12 06:21:56 user nova-compute[71711]:       </nova:ports>
Apr 12 06:21:56 user nova-compute[71711]:     </nova:instance>
Apr 12 06:21:56 user nova-compute[71711]:   </metadata>
Apr 12 06:21:56 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:21:56 user nova-compute[71711]:     <system>
Apr 12 06:21:56 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:21:56 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:21:56 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:21:56 user nova-compute[71711]:       <entry name="serial">149703ba-0e5a-46f3-b988-d864de1c2137</entry>
Apr 12 06:21:56 user nova-compute[71711]:       <entry name="uuid">149703ba-0e5a-46f3-b988-d864de1c2137</entry>
Apr 12 06:21:56 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:21:56 user nova-compute[71711]:     </system>
Apr 12 06:21:56 user nova-compute[71711]:   </sysinfo>
Apr 12 06:21:56 user nova-compute[71711]:   <os>
Apr 12 06:21:56 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:21:56 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:21:56 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:21:56 user nova-compute[71711]:   </os>
Apr 12 06:21:56 user nova-compute[71711]:   <features>
Apr 12 06:21:56 user nova-compute[71711]:     <acpi/>
Apr 12 06:21:56 user nova-compute[71711]:     <apic/>
Apr 12 06:21:56 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:21:56 user nova-compute[71711]:   </features>
Apr 12 06:21:56 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:21:56 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:21:56 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:21:56 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:21:56 user nova-compute[71711]:   </clock>
Apr 12 06:21:56 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:21:56 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:21:56 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:21:56 user nova-compute[71711]:   </cpu>
Apr 12 06:21:56 user nova-compute[71711]:   <devices>
Apr 12 06:21:56 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:21:56 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:21:56 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk"/>
Apr 12 06:21:56 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:21:56 user nova-compute[71711]:     </disk>
Apr 12 06:21:56 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:21:56 user nova-compute[71711]:       <mac address="fa:16:3e:7a:d2:3c"/>
Apr 12 06:21:56 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:21:56 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:21:56 user nova-compute[71711]:       <target dev="tap9c356d39-d5"/>
Apr 12 06:21:56 user nova-compute[71711]:     </interface>
Apr 12 06:21:56 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:21:56 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/console.log" append="off"/>
Apr 12 06:21:56 user nova-compute[71711]:     </serial>
Apr 12 06:21:56 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:21:56 user nova-compute[71711]:     <video>
Apr 12 06:21:56 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:21:56 user nova-compute[71711]:     </video>
Apr 12 06:21:56 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:21:56 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:21:56 user nova-compute[71711]:     </rng>
Apr 12 06:21:56 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:21:56 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:21:56 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:21:56 user nova-compute[71711]:     </memballoon>
Apr 12 06:21:56 user nova-compute[71711]:   </devices>
Apr 12 06:21:56 user nova-compute[71711]: </domain>
Apr 12 06:21:56 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-61268901',display_name='tempest-DeleteServersTestJSON-server-61268901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-61268901',id=3,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e474b11e55eb45ff91f140aae7e2981d',ramdisk_id='',reservation_id='r-aogdq0lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1256853091',owner_user_name='tempest-DeleteServersTestJSON-1256853091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:21:50Z,user_data=None,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',uuid=149703ba-0e5a-46f3-b988-d864de1c2137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "address": "fa:16:3e:7a:d2:3c", "network": {"id": "4f730b67-77d8-4694-9f2d-9c91555a540e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1684522379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e474b11e55eb45ff91f140aae7e2981d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c356d39-d5", "ovs_interfaceid": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Converting VIF {"id": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "address": "fa:16:3e:7a:d2:3c", "network": {"id": "4f730b67-77d8-4694-9f2d-9c91555a540e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1684522379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e474b11e55eb45ff91f140aae7e2981d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c356d39-d5", "ovs_interfaceid": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:d2:3c,bridge_name='br-int',has_traffic_filtering=True,id=9c356d39-d585-49ef-82de-d123a1d5e0d6,network=Network(4f730b67-77d8-4694-9f2d-9c91555a540e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c356d39-d5') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG os_vif [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:d2:3c,bridge_name='br-int',has_traffic_filtering=True,id=9c356d39-d585-49ef-82de-d123a1d5e0d6,network=Network(4f730b67-77d8-4694-9f2d-9c91555a540e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c356d39-d5') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c356d39-d5, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c356d39-d5, col_values=(('external_ids', {'iface-id': '9c356d39-d585-49ef-82de-d123a1d5e0d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:d2:3c', 'vm-uuid': '149703ba-0e5a-46f3-b988-d864de1c2137'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:56 user nova-compute[71711]: INFO os_vif [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:d2:3c,bridge_name='br-int',has_traffic_filtering=True,id=9c356d39-d585-49ef-82de-d123a1d5e0d6,network=Network(4f730b67-77d8-4694-9f2d-9c91555a540e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c356d39-d5')
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:21:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] No VIF found with MAC fa:16:3e:7a:d2:3c, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:21:57 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Successfully created port: 8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:21:57 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280517.9970782, 7dee97a4-9497-43c2-a688-7bedd1441885 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:21:57 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] VM Resumed (Lifecycle Event)
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:58 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Instance spawned successfully.
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.network.neutron [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Updated VIF entry in instance network info cache for port 9c356d39-d585-49ef-82de-d123a1d5e0d6. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.network.neutron [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Updating instance_info_cache with network_info: [{"id": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "address": "fa:16:3e:7a:d2:3c", "network": {"id": "4f730b67-77d8-4694-9f2d-9c91555a540e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1684522379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e474b11e55eb45ff91f140aae7e2981d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c356d39-d5", "ovs_interfaceid": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:58 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280518.0106335, 7dee97a4-9497-43c2-a688-7bedd1441885 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:21:58 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] VM Started (Lifecycle Event)
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-446a6117-d209-480e-b0d4-bcc7a7b43c48 req-93ec4f3b-4353-4a11-94a2-1b3029f3c150 service nova] Releasing lock "refresh_cache-149703ba-0e5a-46f3-b988-d864de1c2137" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-a32815a8-e330-4b02-af5e-898115ac3788 req-4fb6970a-607c-42ed-9f25-fce480d9677c service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a32815a8-e330-4b02-af5e-898115ac3788 req-4fb6970a-607c-42ed-9f25-fce480d9677c service nova] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a32815a8-e330-4b02-af5e-898115ac3788 req-4fb6970a-607c-42ed-9f25-fce480d9677c service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a32815a8-e330-4b02-af5e-898115ac3788 req-4fb6970a-607c-42ed-9f25-fce480d9677c service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-a32815a8-e330-4b02-af5e-898115ac3788 req-4fb6970a-607c-42ed-9f25-fce480d9677c service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] No waiting events found dispatching network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:21:58 user nova-compute[71711]: WARNING nova.compute.manager [req-a32815a8-e330-4b02-af5e-898115ac3788 req-4fb6970a-607c-42ed-9f25-fce480d9677c service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received unexpected event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 for instance with vm_state building and task_state spawning.
Apr 12 06:21:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:58 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:21:58 user nova-compute[71711]: INFO nova.compute.manager [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Took 9.65 seconds to spawn the instance on the hypervisor.
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:21:58 user nova-compute[71711]: INFO nova.compute.manager [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Took 10.51 seconds to build instance.
Apr 12 06:21:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-39908f48-c087-4ffd-b487-d22c865358bb tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.685s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-b6c02c9f-d691-4d6b-866e-1bc621067f33 req-5b1df09a-00e9-4cc6-89cc-b96d8c236a99 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Received event network-vif-plugged-9c356d39-d585-49ef-82de-d123a1d5e0d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:21:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b6c02c9f-d691-4d6b-866e-1bc621067f33 req-5b1df09a-00e9-4cc6-89cc-b96d8c236a99 service nova] Acquiring lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:21:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b6c02c9f-d691-4d6b-866e-1bc621067f33 req-5b1df09a-00e9-4cc6-89cc-b96d8c236a99 service nova] Lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:21:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b6c02c9f-d691-4d6b-866e-1bc621067f33 req-5b1df09a-00e9-4cc6-89cc-b96d8c236a99 service nova] Lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:21:59 user nova-compute[71711]: DEBUG nova.compute.manager [req-b6c02c9f-d691-4d6b-866e-1bc621067f33 req-5b1df09a-00e9-4cc6-89cc-b96d8c236a99 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] No waiting events found dispatching network-vif-plugged-9c356d39-d585-49ef-82de-d123a1d5e0d6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:21:59 user nova-compute[71711]: WARNING nova.compute.manager [req-b6c02c9f-d691-4d6b-866e-1bc621067f33 req-5b1df09a-00e9-4cc6-89cc-b96d8c236a99 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Received unexpected event network-vif-plugged-9c356d39-d585-49ef-82de-d123a1d5e0d6 for instance with vm_state building and task_state spawning.
Apr 12 06:21:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:00 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Successfully updated port: 8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquired lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Received event network-vif-plugged-9c356d39-d585-49ef-82de-d123a1d5e0d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] Acquiring lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] Lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] Lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] No waiting events found dispatching network-vif-plugged-9c356d39-d585-49ef-82de-d123a1d5e0d6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:22:01 user nova-compute[71711]: WARNING nova.compute.manager [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Received unexpected event network-vif-plugged-9c356d39-d585-49ef-82de-d123a1d5e0d6 for instance with vm_state building and task_state spawning.
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-changed-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Refreshing instance network info cache due to event network-changed-8fba3fe8-62b6-46be-a025-3ec5a629ee80. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] Acquiring lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280521.2068403, 149703ba-0e5a-46f3-b988-d864de1c2137 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:22:01 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] VM Resumed (Lifecycle Event)
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:22:01 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Instance spawned successfully.
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:22:01 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280521.206932, 149703ba-0e5a-46f3-b988-d864de1c2137 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:22:01 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] VM Started (Lifecycle Event)
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:22:01 user nova-compute[71711]: INFO nova.compute.manager [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Took 11.30 seconds to spawn the instance on the hypervisor.
Apr 12 06:22:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:01 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:22:01 user nova-compute[71711]: INFO nova.compute.manager [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Took 12.24 seconds to build instance.
Apr 12 06:22:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e39c18c8-56f8-4b5b-aed6-bd61f9720877 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "149703ba-0e5a-46f3-b988-d864de1c2137" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.414s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating instance_info_cache with network_info: [{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Releasing lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance network_info: |[{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] Acquired lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.network.neutron [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Refreshing network info cache for port 8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Start _get_guest_xml network_info=[{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:22:02 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:22:02 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1807692588',display_name='tempest-ServerActionsTestJSON-server-1807692588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1807692588',id=4,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-hktvsdi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:21:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=5b5758b9-4f7e-4e85-8181-e3dfdd84e624,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:22:02 user nova-compute[71711]:   <uuid>5b5758b9-4f7e-4e85-8181-e3dfdd84e624</uuid>
Apr 12 06:22:02 user nova-compute[71711]:   <name>instance-00000004</name>
Apr 12 06:22:02 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:22:02 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:22:02 user nova-compute[71711]:   <metadata>
Apr 12 06:22:02 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:22:02 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:22:02 user nova-compute[71711]:       <nova:name>tempest-ServerActionsTestJSON-server-1807692588</nova:name>
Apr 12 06:22:02 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:22:02</nova:creationTime>
Apr 12 06:22:02 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:22:02 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:22:02 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:22:02 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:22:02 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:22:02 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:22:02 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:22:02 user nova-compute[71711]:       <nova:owner>
Apr 12 06:22:02 user nova-compute[71711]:         <nova:user uuid="ad316acdc89947bbba60c75e9a24d7e9">tempest-ServerActionsTestJSON-752347644-project-member</nova:user>
Apr 12 06:22:02 user nova-compute[71711]:         <nova:project uuid="54fd87c4105246c1ac1bdf424c83b7aa">tempest-ServerActionsTestJSON-752347644</nova:project>
Apr 12 06:22:02 user nova-compute[71711]:       </nova:owner>
Apr 12 06:22:02 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:22:02 user nova-compute[71711]:       <nova:ports>
Apr 12 06:22:02 user nova-compute[71711]:         <nova:port uuid="8fba3fe8-62b6-46be-a025-3ec5a629ee80">
Apr 12 06:22:02 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 06:22:02 user nova-compute[71711]:         </nova:port>
Apr 12 06:22:02 user nova-compute[71711]:       </nova:ports>
Apr 12 06:22:02 user nova-compute[71711]:     </nova:instance>
Apr 12 06:22:02 user nova-compute[71711]:   </metadata>
Apr 12 06:22:02 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:22:02 user nova-compute[71711]:     <system>
Apr 12 06:22:02 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:22:02 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:22:02 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:22:02 user nova-compute[71711]:       <entry name="serial">5b5758b9-4f7e-4e85-8181-e3dfdd84e624</entry>
Apr 12 06:22:02 user nova-compute[71711]:       <entry name="uuid">5b5758b9-4f7e-4e85-8181-e3dfdd84e624</entry>
Apr 12 06:22:02 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:22:02 user nova-compute[71711]:     </system>
Apr 12 06:22:02 user nova-compute[71711]:   </sysinfo>
Apr 12 06:22:02 user nova-compute[71711]:   <os>
Apr 12 06:22:02 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:22:02 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:22:02 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:22:02 user nova-compute[71711]:   </os>
Apr 12 06:22:02 user nova-compute[71711]:   <features>
Apr 12 06:22:02 user nova-compute[71711]:     <acpi/>
Apr 12 06:22:02 user nova-compute[71711]:     <apic/>
Apr 12 06:22:02 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:22:02 user nova-compute[71711]:   </features>
Apr 12 06:22:02 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:22:02 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:22:02 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:22:02 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:22:02 user nova-compute[71711]:   </clock>
Apr 12 06:22:02 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:22:02 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:22:02 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:22:02 user nova-compute[71711]:   </cpu>
Apr 12 06:22:02 user nova-compute[71711]:   <devices>
Apr 12 06:22:02 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:22:02 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:22:02 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk"/>
Apr 12 06:22:02 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:22:02 user nova-compute[71711]:     </disk>
Apr 12 06:22:02 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:22:02 user nova-compute[71711]:       <mac address="fa:16:3e:7c:bb:4d"/>
Apr 12 06:22:02 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:22:02 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:22:02 user nova-compute[71711]:       <target dev="tap8fba3fe8-62"/>
Apr 12 06:22:02 user nova-compute[71711]:     </interface>
Apr 12 06:22:02 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:22:02 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/console.log" append="off"/>
Apr 12 06:22:02 user nova-compute[71711]:     </serial>
Apr 12 06:22:02 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:22:02 user nova-compute[71711]:     <video>
Apr 12 06:22:02 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:22:02 user nova-compute[71711]:     </video>
Apr 12 06:22:02 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:22:02 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:22:02 user nova-compute[71711]:     </rng>
Apr 12 06:22:02 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:22:02 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:22:02 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:22:02 user nova-compute[71711]:     </memballoon>
Apr 12 06:22:02 user nova-compute[71711]:   </devices>
Apr 12 06:22:02 user nova-compute[71711]: </domain>
Apr 12 06:22:02 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1807692588',display_name='tempest-ServerActionsTestJSON-server-1807692588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1807692588',id=4,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-hktvsdi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:21:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=5b5758b9-4f7e-4e85-8181-e3dfdd84e624,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG os_vif [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fba3fe8-62, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fba3fe8-62, col_values=(('external_ids', {'iface-id': '8fba3fe8-62b6-46be-a025-3ec5a629ee80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:bb:4d', 'vm-uuid': '5b5758b9-4f7e-4e85-8181-e3dfdd84e624'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:22:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:03 user nova-compute[71711]: INFO os_vif [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62')
Apr 12 06:22:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:22:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No VIF found with MAC fa:16:3e:7c:bb:4d, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:22:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:04 user nova-compute[71711]: DEBUG nova.network.neutron [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updated VIF entry in instance network info cache for port 8fba3fe8-62b6-46be-a025-3ec5a629ee80. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:22:04 user nova-compute[71711]: DEBUG nova.network.neutron [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating instance_info_cache with network_info: [{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c47ec928-8e9c-4584-8570-2aa7a16e6bb9 req-9823078c-74b9-47f5-b1d2-fbe7e9aeb5b0 service nova] Releasing lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:06 user nova-compute[71711]: DEBUG nova.compute.manager [req-5d614933-1f8f-41eb-bf77-b91366d2cdac req-414bcab6-3370-43a7-b60d-e946c237fd36 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5d614933-1f8f-41eb-bf77-b91366d2cdac req-414bcab6-3370-43a7-b60d-e946c237fd36 service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5d614933-1f8f-41eb-bf77-b91366d2cdac req-414bcab6-3370-43a7-b60d-e946c237fd36 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5d614933-1f8f-41eb-bf77-b91366d2cdac req-414bcab6-3370-43a7-b60d-e946c237fd36 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:06 user nova-compute[71711]: DEBUG nova.compute.manager [req-5d614933-1f8f-41eb-bf77-b91366d2cdac req-414bcab6-3370-43a7-b60d-e946c237fd36 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:22:06 user nova-compute[71711]: WARNING nova.compute.manager [req-5d614933-1f8f-41eb-bf77-b91366d2cdac req-414bcab6-3370-43a7-b60d-e946c237fd36 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state building and task_state spawning.
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280527.8378904, 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:22:07 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] VM Resumed (Lifecycle Event)
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:22:07 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance spawned successfully.
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:07 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280527.8421094, 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:22:07 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] VM Started (Lifecycle Event)
Apr 12 06:22:07 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:08 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:22:08 user nova-compute[71711]: INFO nova.compute.manager [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Took 13.54 seconds to spawn the instance on the hypervisor.
Apr 12 06:22:08 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:08 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:22:08 user nova-compute[71711]: INFO nova.compute.manager [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Took 14.44 seconds to build instance.
Apr 12 06:22:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a35ae731-4556-48e0-b3b9-7e6cc82d82d5 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.630s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-a1fff010-1d64-431f-a4a9-a8d439cbe774 req-7ce74ea8-080f-4197-8e41-96c8ad68da2b service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a1fff010-1d64-431f-a4a9-a8d439cbe774 req-7ce74ea8-080f-4197-8e41-96c8ad68da2b service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a1fff010-1d64-431f-a4a9-a8d439cbe774 req-7ce74ea8-080f-4197-8e41-96c8ad68da2b service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a1fff010-1d64-431f-a4a9-a8d439cbe774 req-7ce74ea8-080f-4197-8e41-96c8ad68da2b service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-a1fff010-1d64-431f-a4a9-a8d439cbe774 req-7ce74ea8-080f-4197-8e41-96c8ad68da2b service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:22:08 user nova-compute[71711]: WARNING nova.compute.manager [req-a1fff010-1d64-431f-a4a9-a8d439cbe774 req-7ce74ea8-080f-4197-8e41-96c8ad68da2b service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state active and task_state None.
Apr 12 06:22:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "eb450dca-84ef-47c4-9038-9269a661bb12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "eb450dca-84ef-47c4-9038-9269a661bb12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG nova.compute.manager [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:22:13 user nova-compute[71711]: INFO nova.compute.claims [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Claim successful on node user
Apr 12 06:22:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.598s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG nova.compute.manager [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.079s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:13 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:22:13 user nova-compute[71711]: INFO nova.compute.claims [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Claim successful on node user
Apr 12 06:22:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG nova.network.neutron [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:22:14 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 12 06:22:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:22:14 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Creating image(s)
Apr 12 06:22:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "/opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "/opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "a1eaee5a671e4b82224a24b868e3760511426204" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "a1eaee5a671e4b82224a24b868e3760511426204" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG nova.policy [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de02e22a24944fdf952fd302b608a293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94e95975f26a4677b628411ddb18c68c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204.part --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.075s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204.part --force-share --output=json" returned: 0 in 0.204s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG nova.virt.images [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 28c48af4-828a-49f8-850e-cec50c5957dd was qcow2, converting to raw {{(pid=71711) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:22:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204.part /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204.converted {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:22:15 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:22:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204.part /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204.converted" returned: 0 in 0.180s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204.converted --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG nova.policy [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:22:15 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Creating image(s)
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204.converted --force-share --output=json" returned: 0 in 0.243s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "a1eaee5a671e4b82224a24b868e3760511426204" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.154s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.193s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204 --force-share --output=json" returned: 0 in 0.168s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "a1eaee5a671e4b82224a24b868e3760511426204" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "a1eaee5a671e4b82224a24b868e3760511426204" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk 1073741824" returned: 0 in 0.049s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204 --force-share --output=json" returned: 0 in 0.189s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204,backing_fmt=raw /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204,backing_fmt=raw /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk 1073741824" returned: 0 in 0.079s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "a1eaee5a671e4b82224a24b868e3760511426204" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.246s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.network.neutron [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Successfully created port: 89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204 --force-share --output=json" returned: 0 in 0.182s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Cannot resize image /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.objects.instance [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lazy-loading 'migration_context' on Instance uuid eb450dca-84ef-47c4-9038-9269a661bb12 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Cannot resize image /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lazy-loading 'migration_context' on Instance uuid 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Ensure instance console log exists: /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Ensure instance console log exists: /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Successfully created port: e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.network.neutron [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Successfully updated port: 89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "refresh_cache-eb450dca-84ef-47c4-9038-9269a661bb12" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquired lock "refresh_cache-eb450dca-84ef-47c4-9038-9269a661bb12" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.network.neutron [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.compute.manager [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Received event network-changed-89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.compute.manager [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Refreshing instance network info cache due to event network-changed-89d27424-e166-42ad-b7e2-1b1a3101f207. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] Acquiring lock "refresh_cache-eb450dca-84ef-47c4-9038-9269a661bb12" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:16 user nova-compute[71711]: DEBUG nova.network.neutron [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.network.neutron [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Updating instance_info_cache with network_info: [{"id": "89d27424-e166-42ad-b7e2-1b1a3101f207", "address": "fa:16:3e:14:7c:2e", "network": {"id": "6e696563-b74d-4d06-adb9-004d4c9e108d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034374773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e95975f26a4677b628411ddb18c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d27424-e1", "ovs_interfaceid": "89d27424-e166-42ad-b7e2-1b1a3101f207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Releasing lock "refresh_cache-eb450dca-84ef-47c4-9038-9269a661bb12" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.compute.manager [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Instance network_info: |[{"id": "89d27424-e166-42ad-b7e2-1b1a3101f207", "address": "fa:16:3e:14:7c:2e", "network": {"id": "6e696563-b74d-4d06-adb9-004d4c9e108d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034374773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e95975f26a4677b628411ddb18c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d27424-e1", "ovs_interfaceid": "89d27424-e166-42ad-b7e2-1b1a3101f207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] Acquired lock "refresh_cache-eb450dca-84ef-47c4-9038-9269a661bb12" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.network.neutron [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Refreshing network info cache for port 89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Start _get_guest_xml network_info=[{"id": "89d27424-e166-42ad-b7e2-1b1a3101f207", "address": "fa:16:3e:14:7c:2e", "network": {"id": "6e696563-b74d-4d06-adb9-004d4c9e108d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034374773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e95975f26a4677b628411ddb18c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d27424-e1", "ovs_interfaceid": "89d27424-e166-42ad-b7e2-1b1a3101f207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:22:05Z,direct_url=<?>,disk_format='qcow2',id=28c48af4-828a-49f8-850e-cec50c5957dd,min_disk=0,min_ram=0,name='',owner='5e17153f09234612a4eaf062b20c52f0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:22:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'guest_format': None, 'image_id': '28c48af4-828a-49f8-850e-cec50c5957dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:22:17 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:22:17 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:22:05Z,direct_url=<?>,disk_format='qcow2',id=28c48af4-828a-49f8-850e-cec50c5957dd,min_disk=0,min_ram=0,name='',owner='5e17153f09234612a4eaf062b20c52f0',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:22:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-196824245',display_name='tempest-AttachSCSIVolumeTestJSON-server-196824245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-196824245',id=5,image_ref='28c48af4-828a-49f8-850e-cec50c5957dd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNu4v/bMjQCtjIiU2fQv/kMUV5IAIKUk3uEo2wdL9cZG/02bIvxNngSgUc7czWm6vruLEHX+C9lIzuK/6LvCcBfbYsBmwF7wSXtfMfN1bdsxihIjrXNuhUi2OQoWZocEg==',key_name='tempest-keypair-939806397',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94e95975f26a4677b628411ddb18c68c',ramdisk_id='',reservation_id='r-xwtiyupi',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='28c48af4-828a-49f8-850e-cec50c5957dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-480153316',owner_user_name='tempest-AttachSCSIVolumeTestJSON-480153316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de02e22a24944fdf952fd302b608a293',uuid=eb450dca-84ef-47c4-9038-9269a661bb12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89d27424-e166-42ad-b7e2-1b1a3101f207", "address": "fa:16:3e:14:7c:2e", "network": {"id": "6e696563-b74d-4d06-adb9-004d4c9e108d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034374773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e95975f26a4677b628411ddb18c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d27424-e1", "ovs_interfaceid": "89d27424-e166-42ad-b7e2-1b1a3101f207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Converting VIF {"id": "89d27424-e166-42ad-b7e2-1b1a3101f207", "address": "fa:16:3e:14:7c:2e", "network": {"id": "6e696563-b74d-4d06-adb9-004d4c9e108d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034374773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e95975f26a4677b628411ddb18c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d27424-e1", "ovs_interfaceid": "89d27424-e166-42ad-b7e2-1b1a3101f207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=89d27424-e166-42ad-b7e2-1b1a3101f207,network=Network(6e696563-b74d-4d06-adb9-004d4c9e108d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d27424-e1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.objects.instance [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lazy-loading 'pci_devices' on Instance uuid eb450dca-84ef-47c4-9038-9269a661bb12 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:22:17 user nova-compute[71711]:   <uuid>eb450dca-84ef-47c4-9038-9269a661bb12</uuid>
Apr 12 06:22:17 user nova-compute[71711]:   <name>instance-00000005</name>
Apr 12 06:22:17 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:22:17 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:22:17 user nova-compute[71711]:   <metadata>
Apr 12 06:22:17 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:22:17 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:22:17 user nova-compute[71711]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-196824245</nova:name>
Apr 12 06:22:17 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:22:17</nova:creationTime>
Apr 12 06:22:17 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:22:17 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:22:17 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:22:17 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:22:17 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:22:17 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:22:17 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:22:17 user nova-compute[71711]:       <nova:owner>
Apr 12 06:22:17 user nova-compute[71711]:         <nova:user uuid="de02e22a24944fdf952fd302b608a293">tempest-AttachSCSIVolumeTestJSON-480153316-project-member</nova:user>
Apr 12 06:22:17 user nova-compute[71711]:         <nova:project uuid="94e95975f26a4677b628411ddb18c68c">tempest-AttachSCSIVolumeTestJSON-480153316</nova:project>
Apr 12 06:22:17 user nova-compute[71711]:       </nova:owner>
Apr 12 06:22:17 user nova-compute[71711]:       <nova:root type="image" uuid="28c48af4-828a-49f8-850e-cec50c5957dd"/>
Apr 12 06:22:17 user nova-compute[71711]:       <nova:ports>
Apr 12 06:22:17 user nova-compute[71711]:         <nova:port uuid="89d27424-e166-42ad-b7e2-1b1a3101f207">
Apr 12 06:22:17 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 06:22:17 user nova-compute[71711]:         </nova:port>
Apr 12 06:22:17 user nova-compute[71711]:       </nova:ports>
Apr 12 06:22:17 user nova-compute[71711]:     </nova:instance>
Apr 12 06:22:17 user nova-compute[71711]:   </metadata>
Apr 12 06:22:17 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:22:17 user nova-compute[71711]:     <system>
Apr 12 06:22:17 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:22:17 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:22:17 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:22:17 user nova-compute[71711]:       <entry name="serial">eb450dca-84ef-47c4-9038-9269a661bb12</entry>
Apr 12 06:22:17 user nova-compute[71711]:       <entry name="uuid">eb450dca-84ef-47c4-9038-9269a661bb12</entry>
Apr 12 06:22:17 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:22:17 user nova-compute[71711]:     </system>
Apr 12 06:22:17 user nova-compute[71711]:   </sysinfo>
Apr 12 06:22:17 user nova-compute[71711]:   <os>
Apr 12 06:22:17 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:22:17 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:22:17 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:22:17 user nova-compute[71711]:   </os>
Apr 12 06:22:17 user nova-compute[71711]:   <features>
Apr 12 06:22:17 user nova-compute[71711]:     <acpi/>
Apr 12 06:22:17 user nova-compute[71711]:     <apic/>
Apr 12 06:22:17 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:22:17 user nova-compute[71711]:   </features>
Apr 12 06:22:17 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:22:17 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:22:17 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:22:17 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:22:17 user nova-compute[71711]:   </clock>
Apr 12 06:22:17 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:22:17 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:22:17 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:22:17 user nova-compute[71711]:   </cpu>
Apr 12 06:22:17 user nova-compute[71711]:   <devices>
Apr 12 06:22:17 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:22:17 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:22:17 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk"/>
Apr 12 06:22:17 user nova-compute[71711]:       <target dev="sda" bus="scsi"/>
Apr 12 06:22:17 user nova-compute[71711]:       <address type="drive" controller="0" unit="0"/>
Apr 12 06:22:17 user nova-compute[71711]:     </disk>
Apr 12 06:22:17 user nova-compute[71711]:     <disk type="file" device="cdrom">
Apr 12 06:22:17 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 06:22:17 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk.config"/>
Apr 12 06:22:17 user nova-compute[71711]:       <target dev="sdb" bus="scsi"/>
Apr 12 06:22:17 user nova-compute[71711]:       <address type="drive" controller="0" unit="1"/>
Apr 12 06:22:17 user nova-compute[71711]:     </disk>
Apr 12 06:22:17 user nova-compute[71711]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 12 06:22:17 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:22:17 user nova-compute[71711]:       <mac address="fa:16:3e:14:7c:2e"/>
Apr 12 06:22:17 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:22:17 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:22:17 user nova-compute[71711]:       <target dev="tap89d27424-e1"/>
Apr 12 06:22:17 user nova-compute[71711]:     </interface>
Apr 12 06:22:17 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:22:17 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/console.log" append="off"/>
Apr 12 06:22:17 user nova-compute[71711]:     </serial>
Apr 12 06:22:17 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:22:17 user nova-compute[71711]:     <video>
Apr 12 06:22:17 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:22:17 user nova-compute[71711]:     </video>
Apr 12 06:22:17 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:22:17 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:22:17 user nova-compute[71711]:     </rng>
Apr 12 06:22:17 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:22:17 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:22:17 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:22:17 user nova-compute[71711]:     </memballoon>
Apr 12 06:22:17 user nova-compute[71711]:   </devices>
Apr 12 06:22:17 user nova-compute[71711]: </domain>
Apr 12 06:22:17 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-196824245',display_name='tempest-AttachSCSIVolumeTestJSON-server-196824245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-196824245',id=5,image_ref='28c48af4-828a-49f8-850e-cec50c5957dd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNu4v/bMjQCtjIiU2fQv/kMUV5IAIKUk3uEo2wdL9cZG/02bIvxNngSgUc7czWm6vruLEHX+C9lIzuK/6LvCcBfbYsBmwF7wSXtfMfN1bdsxihIjrXNuhUi2OQoWZocEg==',key_name='tempest-keypair-939806397',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94e95975f26a4677b628411ddb18c68c',ramdisk_id='',reservation_id='r-xwtiyupi',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='28c48af4-828a-49f8-850e-cec50c5957dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-480153316',owner_user_name='tempest-AttachSCSIVolumeTestJSON-480153316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de02e22a24944fdf952fd302b608a293',uuid=eb450dca-84ef-47c4-9038-9269a661bb12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89d27424-e166-42ad-b7e2-1b1a3101f207", "address": "fa:16:3e:14:7c:2e", "network": {"id": "6e696563-b74d-4d06-adb9-004d4c9e108d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034374773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e95975f26a4677b628411ddb18c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d27424-e1", "ovs_interfaceid": "89d27424-e166-42ad-b7e2-1b1a3101f207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Converting VIF {"id": "89d27424-e166-42ad-b7e2-1b1a3101f207", "address": "fa:16:3e:14:7c:2e", "network": {"id": "6e696563-b74d-4d06-adb9-004d4c9e108d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034374773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e95975f26a4677b628411ddb18c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d27424-e1", "ovs_interfaceid": "89d27424-e166-42ad-b7e2-1b1a3101f207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=89d27424-e166-42ad-b7e2-1b1a3101f207,network=Network(6e696563-b74d-4d06-adb9-004d4c9e108d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d27424-e1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG os_vif [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=89d27424-e166-42ad-b7e2-1b1a3101f207,network=Network(6e696563-b74d-4d06-adb9-004d4c9e108d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d27424-e1') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89d27424-e1, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89d27424-e1, col_values=(('external_ids', {'iface-id': '89d27424-e166-42ad-b7e2-1b1a3101f207', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:7c:2e', 'vm-uuid': 'eb450dca-84ef-47c4-9038-9269a661bb12'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:17 user nova-compute[71711]: INFO os_vif [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=89d27424-e166-42ad-b7e2-1b1a3101f207,network=Network(6e696563-b74d-4d06-adb9-004d4c9e108d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d27424-e1')
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] No BDM found with device name sda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] No VIF found with MAC fa:16:3e:14:7c:2e, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:22:17 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Using config drive
Apr 12 06:22:17 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Creating config drive at /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk.config
Apr 12 06:22:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp69bwp7ss {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp69bwp7ss" returned: 0 in 0.067s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Successfully updated port: e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "33458552-cb23-41c7-9cb7-ef13301468f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquired lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.compute.manager [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-changed-e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Refreshing instance network info cache due to event network-changed-e215c62b-ca21-474c-bb78-e65c3d3a6d23. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] Acquiring lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:17 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:22:18 user nova-compute[71711]: INFO nova.compute.claims [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Claim successful on node user
Apr 12 06:22:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Updating instance_info_cache with network_info: [{"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.network.neutron [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Updated VIF entry in instance network info cache for port 89d27424-e166-42ad-b7e2-1b1a3101f207. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.network.neutron [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Updating instance_info_cache with network_info: [{"id": "89d27424-e166-42ad-b7e2-1b1a3101f207", "address": "fa:16:3e:14:7c:2e", "network": {"id": "6e696563-b74d-4d06-adb9-004d4c9e108d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034374773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e95975f26a4677b628411ddb18c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d27424-e1", "ovs_interfaceid": "89d27424-e166-42ad-b7e2-1b1a3101f207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Releasing lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Instance network_info: |[{"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] Acquired lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.network.neutron [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Refreshing network info cache for port e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Start _get_guest_xml network_info=[{"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-61e5eaf0-65e6-44ef-9ac9-25e62e3fd5c4 req-f6cdb6c9-0652-4935-899d-f219cc30630d service nova] Releasing lock "refresh_cache-eb450dca-84ef-47c4-9038-9269a661bb12" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:18 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:22:18 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535299913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535299913',id=6,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsYFbAoV+s8XfUdzNJguOlyjgf5rzssGClNchETA1Wb0ZBXMDpVCtnjv4m62tZx7TC11beScEz0QICYslGhXYxCCYoznL60xxNw9+KIk2H3I9oh00SIE1sHei3bsDqqwQ==',key_name='tempest-keypair-1020989553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96d2a1b102d54e8194741137e193436f',ramdisk_id='',reservation_id='r-0ngl4bz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1179204824',owner_user_name='tempest-TaggedAttachmentsTest-1179204824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896e1c5d0edd4a1d9d122115f02dfef7',uuid=1c02afd2-428b-49c9-a5e9-016fdeab1046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converting VIF {"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:fb:33,bridge_name='br-int',has_traffic_filtering=True,id=e215c62b-ca21-474c-bb78-e65c3d3a6d23,network=Network(00422635-29f9-424b-99fd-93e32fe08520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape215c62b-ca') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:22:18 user nova-compute[71711]:   <uuid>1c02afd2-428b-49c9-a5e9-016fdeab1046</uuid>
Apr 12 06:22:18 user nova-compute[71711]:   <name>instance-00000006</name>
Apr 12 06:22:18 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:22:18 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:22:18 user nova-compute[71711]:   <metadata>
Apr 12 06:22:18 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:22:18 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:22:18 user nova-compute[71711]:       <nova:name>tempest-device-tagging-server-535299913</nova:name>
Apr 12 06:22:18 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:22:18</nova:creationTime>
Apr 12 06:22:18 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:22:18 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:22:18 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:22:18 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:22:18 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:22:18 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:22:18 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:22:18 user nova-compute[71711]:       <nova:owner>
Apr 12 06:22:18 user nova-compute[71711]:         <nova:user uuid="896e1c5d0edd4a1d9d122115f02dfef7">tempest-TaggedAttachmentsTest-1179204824-project-member</nova:user>
Apr 12 06:22:18 user nova-compute[71711]:         <nova:project uuid="96d2a1b102d54e8194741137e193436f">tempest-TaggedAttachmentsTest-1179204824</nova:project>
Apr 12 06:22:18 user nova-compute[71711]:       </nova:owner>
Apr 12 06:22:18 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:22:18 user nova-compute[71711]:       <nova:ports>
Apr 12 06:22:18 user nova-compute[71711]:         <nova:port uuid="e215c62b-ca21-474c-bb78-e65c3d3a6d23">
Apr 12 06:22:18 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:22:18 user nova-compute[71711]:         </nova:port>
Apr 12 06:22:18 user nova-compute[71711]:       </nova:ports>
Apr 12 06:22:18 user nova-compute[71711]:     </nova:instance>
Apr 12 06:22:18 user nova-compute[71711]:   </metadata>
Apr 12 06:22:18 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:22:18 user nova-compute[71711]:     <system>
Apr 12 06:22:18 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:22:18 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:22:18 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:22:18 user nova-compute[71711]:       <entry name="serial">1c02afd2-428b-49c9-a5e9-016fdeab1046</entry>
Apr 12 06:22:18 user nova-compute[71711]:       <entry name="uuid">1c02afd2-428b-49c9-a5e9-016fdeab1046</entry>
Apr 12 06:22:18 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:22:18 user nova-compute[71711]:     </system>
Apr 12 06:22:18 user nova-compute[71711]:   </sysinfo>
Apr 12 06:22:18 user nova-compute[71711]:   <os>
Apr 12 06:22:18 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:22:18 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:22:18 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:22:18 user nova-compute[71711]:   </os>
Apr 12 06:22:18 user nova-compute[71711]:   <features>
Apr 12 06:22:18 user nova-compute[71711]:     <acpi/>
Apr 12 06:22:18 user nova-compute[71711]:     <apic/>
Apr 12 06:22:18 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:22:18 user nova-compute[71711]:   </features>
Apr 12 06:22:18 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:22:18 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:22:18 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:22:18 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:22:18 user nova-compute[71711]:   </clock>
Apr 12 06:22:18 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:22:18 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:22:18 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:22:18 user nova-compute[71711]:   </cpu>
Apr 12 06:22:18 user nova-compute[71711]:   <devices>
Apr 12 06:22:18 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:22:18 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:22:18 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk"/>
Apr 12 06:22:18 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:22:18 user nova-compute[71711]:     </disk>
Apr 12 06:22:18 user nova-compute[71711]:     <disk type="file" device="cdrom">
Apr 12 06:22:18 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 06:22:18 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk.config"/>
Apr 12 06:22:18 user nova-compute[71711]:       <target dev="hda" bus="ide"/>
Apr 12 06:22:18 user nova-compute[71711]:     </disk>
Apr 12 06:22:18 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:22:18 user nova-compute[71711]:       <mac address="fa:16:3e:fb:fb:33"/>
Apr 12 06:22:18 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:22:18 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:22:18 user nova-compute[71711]:       <target dev="tape215c62b-ca"/>
Apr 12 06:22:18 user nova-compute[71711]:     </interface>
Apr 12 06:22:18 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:22:18 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/console.log" append="off"/>
Apr 12 06:22:18 user nova-compute[71711]:     </serial>
Apr 12 06:22:18 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:22:18 user nova-compute[71711]:     <video>
Apr 12 06:22:18 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:22:18 user nova-compute[71711]:     </video>
Apr 12 06:22:18 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:22:18 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:22:18 user nova-compute[71711]:     </rng>
Apr 12 06:22:18 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:22:18 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:22:18 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:22:18 user nova-compute[71711]:     </memballoon>
Apr 12 06:22:18 user nova-compute[71711]:   </devices>
Apr 12 06:22:18 user nova-compute[71711]: </domain>
Apr 12 06:22:18 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535299913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535299913',id=6,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsYFbAoV+s8XfUdzNJguOlyjgf5rzssGClNchETA1Wb0ZBXMDpVCtnjv4m62tZx7TC11beScEz0QICYslGhXYxCCYoznL60xxNw9+KIk2H3I9oh00SIE1sHei3bsDqqwQ==',key_name='tempest-keypair-1020989553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96d2a1b102d54e8194741137e193436f',ramdisk_id='',reservation_id='r-0ngl4bz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1179204824',owner_user_name='tempest-TaggedAttachmentsTest-1179204824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896e1c5d0edd4a1d9d122115f02dfef7',uuid=1c02afd2-428b-49c9-a5e9-016fdeab1046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converting VIF {"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:fb:33,bridge_name='br-int',has_traffic_filtering=True,id=e215c62b-ca21-474c-bb78-e65c3d3a6d23,network=Network(00422635-29f9-424b-99fd-93e32fe08520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape215c62b-ca') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG os_vif [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:fb:33,bridge_name='br-int',has_traffic_filtering=True,id=e215c62b-ca21-474c-bb78-e65c3d3a6d23,network=Network(00422635-29f9-424b-99fd-93e32fe08520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape215c62b-ca') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape215c62b-ca, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape215c62b-ca, col_values=(('external_ids', {'iface-id': 'e215c62b-ca21-474c-bb78-e65c3d3a6d23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:fb:33', 'vm-uuid': '1c02afd2-428b-49c9-a5e9-016fdeab1046'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:18 user nova-compute[71711]: INFO os_vif [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:fb:33,bridge_name='br-int',has_traffic_filtering=True,id=e215c62b-ca21-474c-bb78-e65c3d3a6d23,network=Network(00422635-29f9-424b-99fd-93e32fe08520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape215c62b-ca')
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] No BDM found with device name hda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] No VIF found with MAC fa:16:3e:fb:fb:33, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:22:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Using config drive
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.network.neutron [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:22:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:22:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Creating config drive at /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk.config
Apr 12 06:22:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgij0957t {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:22:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Creating image(s)
Apr 12 06:22:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "/opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "/opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "/opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.policy [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f053ed1c99c0480c9d1b0bc466e49e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff56a846b9e34aada0c72df46d47b77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgij0957t" returned: 0 in 0.087s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.network.neutron [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Updated VIF entry in instance network info cache for port e215c62b-ca21-474c-bb78-e65c3d3a6d23. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG nova.network.neutron [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Updating instance_info_cache with network_info: [{"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cf3b98dc-817d-4db2-9dc3-6ae6fe792a9d req-1ee1b8cf-76aa-4c99-9983-0c68882e76ea service nova] Releasing lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.178s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.171s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk 1073741824" returned: 0 in 0.126s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.175s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Cannot resize image /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG nova.objects.instance [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lazy-loading 'migration_context' on Instance uuid 33458552-cb23-41c7-9cb7-ef13301468f6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Ensure instance console log exists: /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.006s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG nova.network.neutron [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Successfully created port: f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-c319f0a6-c7ed-46f8-a3f3-e11ecd2b51a8 req-e8b86f0a-d683-494d-8e2c-be146ccefc8c service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Received event network-vif-plugged-89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c319f0a6-c7ed-46f8-a3f3-e11ecd2b51a8 req-e8b86f0a-d683-494d-8e2c-be146ccefc8c service nova] Acquiring lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c319f0a6-c7ed-46f8-a3f3-e11ecd2b51a8 req-e8b86f0a-d683-494d-8e2c-be146ccefc8c service nova] Lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c319f0a6-c7ed-46f8-a3f3-e11ecd2b51a8 req-e8b86f0a-d683-494d-8e2c-be146ccefc8c service nova] Lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-c319f0a6-c7ed-46f8-a3f3-e11ecd2b51a8 req-e8b86f0a-d683-494d-8e2c-be146ccefc8c service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] No waiting events found dispatching network-vif-plugged-89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:22:20 user nova-compute[71711]: WARNING nova.compute.manager [req-c319f0a6-c7ed-46f8-a3f3-e11ecd2b51a8 req-e8b86f0a-d683-494d-8e2c-be146ccefc8c service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Received unexpected event network-vif-plugged-89d27424-e166-42ad-b7e2-1b1a3101f207 for instance with vm_state building and task_state spawning.
Apr 12 06:22:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG nova.network.neutron [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Successfully updated port: f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "refresh_cache-33458552-cb23-41c7-9cb7-ef13301468f6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquired lock "refresh_cache-33458552-cb23-41c7-9cb7-ef13301468f6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG nova.network.neutron [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Received event network-changed-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Refreshing instance network info cache due to event network-changed-f6ee077c-02a5-41ec-85b8-56bc6aeddd39. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] Acquiring lock "refresh_cache-33458552-cb23-41c7-9cb7-ef13301468f6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:20 user nova-compute[71711]: DEBUG nova.network.neutron [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.network.neutron [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Updating instance_info_cache with network_info: [{"id": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "address": "fa:16:3e:56:fb:fd", "network": {"id": "0b9e975b-f79a-4346-a4ba-543f9560aba7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1629057747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff56a846b9e34aada0c72df46d47b77d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ee077c-02", "ovs_interfaceid": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Releasing lock "refresh_cache-33458552-cb23-41c7-9cb7-ef13301468f6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Instance network_info: |[{"id": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "address": "fa:16:3e:56:fb:fd", "network": {"id": "0b9e975b-f79a-4346-a4ba-543f9560aba7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1629057747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff56a846b9e34aada0c72df46d47b77d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ee077c-02", "ovs_interfaceid": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] Acquired lock "refresh_cache-33458552-cb23-41c7-9cb7-ef13301468f6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.network.neutron [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Refreshing network info cache for port f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Start _get_guest_xml network_info=[{"id": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "address": "fa:16:3e:56:fb:fd", "network": {"id": "0b9e975b-f79a-4346-a4ba-543f9560aba7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1629057747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff56a846b9e34aada0c72df46d47b77d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ee077c-02", "ovs_interfaceid": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:22:21 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:22:21 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:22:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2009329208',display_name='tempest-TestVolumeSwap-server-2009329208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2009329208',id=7,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR2iwubxgd67bcfbYSIQ4InvaMveVw40BYu/RkOLGoTl7STVma0BPiTSi090ksb72jogJXIn3Y1rI+7tIGtilTjYycBsCQDhXALmgJddDEyoe9QKkV0XFtcCerGg6FL8Q==',key_name='tempest-keypair-1426278107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff56a846b9e34aada0c72df46d47b77d',ramdisk_id='',reservation_id='r-8jieoqnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1856443697',owner_user_name='tempest-TestVolumeSwap-1856443697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f053ed1c99c0480c9d1b0bc466e49e08',uuid=33458552-cb23-41c7-9cb7-ef13301468f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "address": "fa:16:3e:56:fb:fd", "network": {"id": "0b9e975b-f79a-4346-a4ba-543f9560aba7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1629057747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff56a846b9e34aada0c72df46d47b77d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ee077c-02", "ovs_interfaceid": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Converting VIF {"id": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "address": "fa:16:3e:56:fb:fd", "network": {"id": "0b9e975b-f79a-4346-a4ba-543f9560aba7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1629057747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff56a846b9e34aada0c72df46d47b77d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ee077c-02", "ovs_interfaceid": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ee077c-02a5-41ec-85b8-56bc6aeddd39,network=Network(0b9e975b-f79a-4346-a4ba-543f9560aba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ee077c-02') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.objects.instance [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lazy-loading 'pci_devices' on Instance uuid 33458552-cb23-41c7-9cb7-ef13301468f6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:22:21 user nova-compute[71711]:   <uuid>33458552-cb23-41c7-9cb7-ef13301468f6</uuid>
Apr 12 06:22:21 user nova-compute[71711]:   <name>instance-00000007</name>
Apr 12 06:22:21 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:22:21 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:22:21 user nova-compute[71711]:   <metadata>
Apr 12 06:22:21 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:22:21 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:22:21 user nova-compute[71711]:       <nova:name>tempest-TestVolumeSwap-server-2009329208</nova:name>
Apr 12 06:22:21 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:22:21</nova:creationTime>
Apr 12 06:22:21 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:22:21 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:22:21 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:22:21 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:22:21 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:22:21 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:22:21 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:22:21 user nova-compute[71711]:       <nova:owner>
Apr 12 06:22:21 user nova-compute[71711]:         <nova:user uuid="f053ed1c99c0480c9d1b0bc466e49e08">tempest-TestVolumeSwap-1856443697-project-member</nova:user>
Apr 12 06:22:21 user nova-compute[71711]:         <nova:project uuid="ff56a846b9e34aada0c72df46d47b77d">tempest-TestVolumeSwap-1856443697</nova:project>
Apr 12 06:22:21 user nova-compute[71711]:       </nova:owner>
Apr 12 06:22:21 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:22:21 user nova-compute[71711]:       <nova:ports>
Apr 12 06:22:21 user nova-compute[71711]:         <nova:port uuid="f6ee077c-02a5-41ec-85b8-56bc6aeddd39">
Apr 12 06:22:21 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 06:22:21 user nova-compute[71711]:         </nova:port>
Apr 12 06:22:21 user nova-compute[71711]:       </nova:ports>
Apr 12 06:22:21 user nova-compute[71711]:     </nova:instance>
Apr 12 06:22:21 user nova-compute[71711]:   </metadata>
Apr 12 06:22:21 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:22:21 user nova-compute[71711]:     <system>
Apr 12 06:22:21 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:22:21 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:22:21 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:22:21 user nova-compute[71711]:       <entry name="serial">33458552-cb23-41c7-9cb7-ef13301468f6</entry>
Apr 12 06:22:21 user nova-compute[71711]:       <entry name="uuid">33458552-cb23-41c7-9cb7-ef13301468f6</entry>
Apr 12 06:22:21 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:22:21 user nova-compute[71711]:     </system>
Apr 12 06:22:21 user nova-compute[71711]:   </sysinfo>
Apr 12 06:22:21 user nova-compute[71711]:   <os>
Apr 12 06:22:21 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:22:21 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:22:21 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:22:21 user nova-compute[71711]:   </os>
Apr 12 06:22:21 user nova-compute[71711]:   <features>
Apr 12 06:22:21 user nova-compute[71711]:     <acpi/>
Apr 12 06:22:21 user nova-compute[71711]:     <apic/>
Apr 12 06:22:21 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:22:21 user nova-compute[71711]:   </features>
Apr 12 06:22:21 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:22:21 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:22:21 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:22:21 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:22:21 user nova-compute[71711]:   </clock>
Apr 12 06:22:21 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:22:21 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:22:21 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:22:21 user nova-compute[71711]:   </cpu>
Apr 12 06:22:21 user nova-compute[71711]:   <devices>
Apr 12 06:22:21 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:22:21 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:22:21 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk"/>
Apr 12 06:22:21 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:22:21 user nova-compute[71711]:     </disk>
Apr 12 06:22:21 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:22:21 user nova-compute[71711]:       <mac address="fa:16:3e:56:fb:fd"/>
Apr 12 06:22:21 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:22:21 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:22:21 user nova-compute[71711]:       <target dev="tapf6ee077c-02"/>
Apr 12 06:22:21 user nova-compute[71711]:     </interface>
Apr 12 06:22:21 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:22:21 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/console.log" append="off"/>
Apr 12 06:22:21 user nova-compute[71711]:     </serial>
Apr 12 06:22:21 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:22:21 user nova-compute[71711]:     <video>
Apr 12 06:22:21 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:22:21 user nova-compute[71711]:     </video>
Apr 12 06:22:21 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:22:21 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:22:21 user nova-compute[71711]:     </rng>
Apr 12 06:22:21 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:22:21 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:22:21 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:22:21 user nova-compute[71711]:     </memballoon>
Apr 12 06:22:21 user nova-compute[71711]:   </devices>
Apr 12 06:22:21 user nova-compute[71711]: </domain>
Apr 12 06:22:21 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:22:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2009329208',display_name='tempest-TestVolumeSwap-server-2009329208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2009329208',id=7,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR2iwubxgd67bcfbYSIQ4InvaMveVw40BYu/RkOLGoTl7STVma0BPiTSi090ksb72jogJXIn3Y1rI+7tIGtilTjYycBsCQDhXALmgJddDEyoe9QKkV0XFtcCerGg6FL8Q==',key_name='tempest-keypair-1426278107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff56a846b9e34aada0c72df46d47b77d',ramdisk_id='',reservation_id='r-8jieoqnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1856443697',owner_user_name='tempest-TestVolumeSwap-1856443697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f053ed1c99c0480c9d1b0bc466e49e08',uuid=33458552-cb23-41c7-9cb7-ef13301468f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "address": "fa:16:3e:56:fb:fd", "network": {"id": "0b9e975b-f79a-4346-a4ba-543f9560aba7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1629057747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff56a846b9e34aada0c72df46d47b77d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ee077c-02", "ovs_interfaceid": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Converting VIF {"id": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "address": "fa:16:3e:56:fb:fd", "network": {"id": "0b9e975b-f79a-4346-a4ba-543f9560aba7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1629057747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff56a846b9e34aada0c72df46d47b77d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ee077c-02", "ovs_interfaceid": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ee077c-02a5-41ec-85b8-56bc6aeddd39,network=Network(0b9e975b-f79a-4346-a4ba-543f9560aba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ee077c-02') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG os_vif [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ee077c-02a5-41ec-85b8-56bc6aeddd39,network=Network(0b9e975b-f79a-4346-a4ba-543f9560aba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ee077c-02') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6ee077c-02, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf6ee077c-02, col_values=(('external_ids', {'iface-id': 'f6ee077c-02a5-41ec-85b8-56bc6aeddd39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:fb:fd', 'vm-uuid': '33458552-cb23-41c7-9cb7-ef13301468f6'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:21 user nova-compute[71711]: INFO os_vif [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ee077c-02a5-41ec-85b8-56bc6aeddd39,network=Network(0b9e975b-f79a-4346-a4ba-543f9560aba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ee077c-02')
Apr 12 06:22:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] No VIF found with MAC fa:16:3e:56:fb:fd, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.network.neutron [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Updated VIF entry in instance network info cache for port f6ee077c-02a5-41ec-85b8-56bc6aeddd39. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.network.neutron [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Updating instance_info_cache with network_info: [{"id": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "address": "fa:16:3e:56:fb:fd", "network": {"id": "0b9e975b-f79a-4346-a4ba-543f9560aba7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1629057747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff56a846b9e34aada0c72df46d47b77d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ee077c-02", "ovs_interfaceid": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-dac1b3da-8383-4f78-817b-1060e8a9b452 req-dd22a5db-429e-4e9f-9c31-96bd0f47db1f service nova] Releasing lock "refresh_cache-33458552-cb23-41c7-9cb7-ef13301468f6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-16977d64-4b0c-41d8-ad2f-2f1741dba0ad req-74ee142e-e2e2-4b70-b254-3fc2018a7f17 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-vif-plugged-e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-16977d64-4b0c-41d8-ad2f-2f1741dba0ad req-74ee142e-e2e2-4b70-b254-3fc2018a7f17 service nova] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-16977d64-4b0c-41d8-ad2f-2f1741dba0ad req-74ee142e-e2e2-4b70-b254-3fc2018a7f17 service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-16977d64-4b0c-41d8-ad2f-2f1741dba0ad req-74ee142e-e2e2-4b70-b254-3fc2018a7f17 service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-16977d64-4b0c-41d8-ad2f-2f1741dba0ad req-74ee142e-e2e2-4b70-b254-3fc2018a7f17 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] No waiting events found dispatching network-vif-plugged-e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:22:21 user nova-compute[71711]: WARNING nova.compute.manager [req-16977d64-4b0c-41d8-ad2f-2f1741dba0ad req-74ee142e-e2e2-4b70-b254-3fc2018a7f17 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received unexpected event network-vif-plugged-e215c62b-ca21-474c-bb78-e65c3d3a6d23 for instance with vm_state building and task_state spawning.
Apr 12 06:22:22 user nova-compute[71711]: DEBUG nova.compute.manager [req-c1bbeacd-2533-458f-80ab-9f3d9d8f73c3 req-30ae5afb-9a34-43bf-ada2-84c0ba9b0a2b service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Received event network-vif-plugged-89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c1bbeacd-2533-458f-80ab-9f3d9d8f73c3 req-30ae5afb-9a34-43bf-ada2-84c0ba9b0a2b service nova] Acquiring lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c1bbeacd-2533-458f-80ab-9f3d9d8f73c3 req-30ae5afb-9a34-43bf-ada2-84c0ba9b0a2b service nova] Lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c1bbeacd-2533-458f-80ab-9f3d9d8f73c3 req-30ae5afb-9a34-43bf-ada2-84c0ba9b0a2b service nova] Lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:22 user nova-compute[71711]: DEBUG nova.compute.manager [req-c1bbeacd-2533-458f-80ab-9f3d9d8f73c3 req-30ae5afb-9a34-43bf-ada2-84c0ba9b0a2b service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] No waiting events found dispatching network-vif-plugged-89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:22:22 user nova-compute[71711]: WARNING nova.compute.manager [req-c1bbeacd-2533-458f-80ab-9f3d9d8f73c3 req-30ae5afb-9a34-43bf-ada2-84c0ba9b0a2b service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Received unexpected event network-vif-plugged-89d27424-e166-42ad-b7e2-1b1a3101f207 for instance with vm_state building and task_state spawning.
Apr 12 06:22:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-d369462f-ccad-4885-a971-cc16b005c2ae req-6a5167aa-e203-47bb-83c9-b5c4fb3a9f22 service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Received event network-vif-plugged-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d369462f-ccad-4885-a971-cc16b005c2ae req-6a5167aa-e203-47bb-83c9-b5c4fb3a9f22 service nova] Acquiring lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d369462f-ccad-4885-a971-cc16b005c2ae req-6a5167aa-e203-47bb-83c9-b5c4fb3a9f22 service nova] Lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d369462f-ccad-4885-a971-cc16b005c2ae req-6a5167aa-e203-47bb-83c9-b5c4fb3a9f22 service nova] Lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-d369462f-ccad-4885-a971-cc16b005c2ae req-6a5167aa-e203-47bb-83c9-b5c4fb3a9f22 service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] No waiting events found dispatching network-vif-plugged-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:22:23 user nova-compute[71711]: WARNING nova.compute.manager [req-d369462f-ccad-4885-a971-cc16b005c2ae req-6a5167aa-e203-47bb-83c9-b5c4fb3a9f22 service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Received unexpected event network-vif-plugged-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 for instance with vm_state building and task_state spawning.
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280543.7302718, eb450dca-84ef-47c4-9038-9269a661bb12 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:22:23 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] VM Resumed (Lifecycle Event)
Apr 12 06:22:23 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Instance spawned successfully.
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:22:23 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280543.7304842, eb450dca-84ef-47c4-9038-9269a661bb12 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:22:23 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] VM Started (Lifecycle Event)
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:22:24 user nova-compute[71711]: DEBUG nova.compute.manager [req-14c88bc5-5a63-4cf5-b810-787d51431c87 req-3f953e60-af8c-44d4-af60-5db993252c2f service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-vif-plugged-e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-14c88bc5-5a63-4cf5-b810-787d51431c87 req-3f953e60-af8c-44d4-af60-5db993252c2f service nova] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-14c88bc5-5a63-4cf5-b810-787d51431c87 req-3f953e60-af8c-44d4-af60-5db993252c2f service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-14c88bc5-5a63-4cf5-b810-787d51431c87 req-3f953e60-af8c-44d4-af60-5db993252c2f service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:24 user nova-compute[71711]: DEBUG nova.compute.manager [req-14c88bc5-5a63-4cf5-b810-787d51431c87 req-3f953e60-af8c-44d4-af60-5db993252c2f service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] No waiting events found dispatching network-vif-plugged-e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:22:24 user nova-compute[71711]: WARNING nova.compute.manager [req-14c88bc5-5a63-4cf5-b810-787d51431c87 req-3f953e60-af8c-44d4-af60-5db993252c2f service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received unexpected event network-vif-plugged-e215c62b-ca21-474c-bb78-e65c3d3a6d23 for instance with vm_state building and task_state spawning.
Apr 12 06:22:24 user nova-compute[71711]: INFO nova.compute.manager [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Took 9.75 seconds to spawn the instance on the hypervisor.
Apr 12 06:22:24 user nova-compute[71711]: DEBUG nova.compute.manager [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:24 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:22:24 user nova-compute[71711]: INFO nova.compute.manager [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Took 11.05 seconds to build instance.
Apr 12 06:22:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cec96f5a-0ce5-45bb-ad44-cf66e1a852aa tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "eb450dca-84ef-47c4-9038-9269a661bb12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.224s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-adf4dd60-6b4f-4c54-81b4-1f213c9e2603 req-b6b8dd85-681e-4efc-ac4a-39f7b2054c5a service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Received event network-vif-plugged-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-adf4dd60-6b4f-4c54-81b4-1f213c9e2603 req-b6b8dd85-681e-4efc-ac4a-39f7b2054c5a service nova] Acquiring lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-adf4dd60-6b4f-4c54-81b4-1f213c9e2603 req-b6b8dd85-681e-4efc-ac4a-39f7b2054c5a service nova] Lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-adf4dd60-6b4f-4c54-81b4-1f213c9e2603 req-b6b8dd85-681e-4efc-ac4a-39f7b2054c5a service nova] Lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-adf4dd60-6b4f-4c54-81b4-1f213c9e2603 req-b6b8dd85-681e-4efc-ac4a-39f7b2054c5a service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] No waiting events found dispatching network-vif-plugged-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:22:25 user nova-compute[71711]: WARNING nova.compute.manager [req-adf4dd60-6b4f-4c54-81b4-1f213c9e2603 req-b6b8dd85-681e-4efc-ac4a-39f7b2054c5a service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Received unexpected event network-vif-plugged-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 for instance with vm_state building and task_state spawning.
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280545.690686, 1c02afd2-428b-49c9-a5e9-016fdeab1046 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:22:25 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] VM Resumed (Lifecycle Event)
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:22:25 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Instance spawned successfully.
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:25 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280545.6953373, 1c02afd2-428b-49c9-a5e9-016fdeab1046 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:22:25 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] VM Started (Lifecycle Event)
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:22:25 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:22:25 user nova-compute[71711]: INFO nova.compute.manager [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Took 10.55 seconds to spawn the instance on the hypervisor.
Apr 12 06:22:25 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:26 user nova-compute[71711]: INFO nova.compute.manager [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Took 12.38 seconds to build instance.
Apr 12 06:22:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e60dfd03-c081-4ab5-9deb-3d54e2ef72e1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.535s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280546.33185, 33458552-cb23-41c7-9cb7-ef13301468f6 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:22:26 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] VM Resumed (Lifecycle Event)
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:22:26 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Instance spawned successfully.
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:26 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280546.3331742, 33458552-cb23-41c7-9cb7-ef13301468f6 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:22:26 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] VM Started (Lifecycle Event)
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:22:26 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:22:26 user nova-compute[71711]: INFO nova.compute.manager [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Took 7.73 seconds to spawn the instance on the hypervisor.
Apr 12 06:22:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:26 user nova-compute[71711]: INFO nova.compute.manager [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Took 8.66 seconds to build instance.
Apr 12 06:22:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9307b9aa-8782-4e8a-8c06-b6035a3af0fe tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.817s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:22:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 06:22:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] There are 0 instances to clean {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 06:22:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:22:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71711) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 06:22:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:22:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:37 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:22:37 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:22:38 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:22:38 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:22:38 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:22:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:22:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:39 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:22:39 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:22:39 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:22:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-46b32f3f-86c4-450a-a710-7d0c05ea4097" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-46b32f3f-86c4-450a-a710-7d0c05ea4097" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:39 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:22:39 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid 46b32f3f-86c4-450a-a710-7d0c05ea4097 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:22:39 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Updating instance_info_cache with network_info: [{"id": "33f085d7-b843-4c48-8379-a5c2690a4231", "address": "fa:16:3e:4e:28:c3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f085d7-b8", "ovs_interfaceid": "33f085d7-b843-4c48-8379-a5c2690a4231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-46b32f3f-86c4-450a-a710-7d0c05ea4097" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:39 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:42 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:22:42 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:22:42 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7898MB free_disk=26.540950775146484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:22:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "a528e600-7358-4b92-9b71-12759f405b38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "a528e600-7358-4b92-9b71-12759f405b38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7dee97a4-9497-43c2-a688-7bedd1441885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 149703ba-0e5a-46f3-b988-d864de1c2137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance eb450dca-84ef-47c4-9038-9269a661bb12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 33458552-cb23-41c7-9cb7-ef13301468f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance a528e600-7358-4b92-9b71-12759f405b38 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing inventories for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating ProviderTree inventory for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating inventory in ProviderTree for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing aggregate associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, aggregates: None {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing trait associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, traits: HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.924s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.596s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:43 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:22:43 user nova-compute[71711]: INFO nova.compute.claims [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Claim successful on node user
Apr 12 06:22:44 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:22:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:22:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG nova.policy [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd59314e79d0344a2943391c3c2ab628a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7d74130d4d417a93de352381229948', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:22:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Creating image(s)
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "/opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "/opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "/opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.145s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:22:44 user nova-compute[71711]: INFO nova.compute.claims [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Claim successful on node user
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk 1073741824" returned: 0 in 0.055s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:22:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Cannot resize image /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'migration_context' on Instance uuid a528e600-7358-4b92-9b71-12759f405b38 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Ensure instance console log exists: /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:22:45 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:22:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:22:45 user nova-compute[71711]: INFO nova.virt.block_device [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Booting with volume 6938de6c-91d6-44b2-af51-33e34e241f29 at /dev/vda
Apr 12 06:22:45 user nova-compute[71711]: DEBUG nova.policy [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '977b800fab264446b0492c93b0dc12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e313922ba234462285d20a4f1f2d88d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:22:45 user nova-compute[71711]: DEBUG os_brick.utils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:22:45 user nova-compute[71711]: INFO oslo.privsep.daemon [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmptpm34sa6/privsep.sock']
Apr 12 06:22:45 user sudo[81774]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmptpm34sa6/privsep.sock
Apr 12 06:22:45 user sudo[81774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 06:22:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:46 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Successfully created port: 039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:22:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:46 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Successfully created port: 55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Successfully created port: f984771f-43c1-4565-8e7f-34d142b19801 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:22:47 user sudo[81774]: pam_unix(sudo:session): session closed for user root
Apr 12 06:22:47 user nova-compute[71711]: INFO oslo.privsep.daemon [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Spawned new privsep daemon via rootwrap
Apr 12 06:22:47 user nova-compute[71711]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 06:22:47 user nova-compute[71711]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 06:22:47 user nova-compute[71711]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 12 06:22:47 user nova-compute[71711]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81777
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac9251e-9e66-4483-a730-714ce4916795]: (2,) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Successfully created port: 6ee43811-1303-4a84-8bd4-0de882daac34 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda01636-8e08-4b0b-bace-fe12af722940]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:47 user nova-compute[71711]: WARNING os_brick.initiator.connectors.nvmeof [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3c1f46-7bee-4381-a9c8-17528370cc44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[35502f54-ed46-44bc-b5cd-d95276419263]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14d713b-187f-4c48-95ce-3170bbb8e604]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:22:47 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:22:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[993f962d-1df1-44f8-aefb-1cc76dc80839]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG os_brick.utils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] <== get_connector_properties: return (2145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:22:47 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating existing volume attachment record: 7de96b37-b23a-4ffb-a822-75cc529fde57 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Successfully updated port: 039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "refresh_cache-a528e600-7358-4b92-9b71-12759f405b38" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquired lock "refresh_cache-a528e600-7358-4b92-9b71-12759f405b38" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.compute.manager [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Received event network-changed-039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.compute.manager [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Refreshing instance network info cache due to event network-changed-039ecba8-673d-41c4-a5bd-f5671896c181. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] Acquiring lock "refresh_cache-a528e600-7358-4b92-9b71-12759f405b38" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Updating instance_info_cache with network_info: [{"id": "039ecba8-673d-41c4-a5bd-f5671896c181", "address": "fa:16:3e:d6:d7:ba", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039ecba8-67", "ovs_interfaceid": "039ecba8-673d-41c4-a5bd-f5671896c181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Releasing lock "refresh_cache-a528e600-7358-4b92-9b71-12759f405b38" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Instance network_info: |[{"id": "039ecba8-673d-41c4-a5bd-f5671896c181", "address": "fa:16:3e:d6:d7:ba", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039ecba8-67", "ovs_interfaceid": "039ecba8-673d-41c4-a5bd-f5671896c181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] Acquired lock "refresh_cache-a528e600-7358-4b92-9b71-12759f405b38" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.network.neutron [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Refreshing network info cache for port 039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Start _get_guest_xml network_info=[{"id": "039ecba8-673d-41c4-a5bd-f5671896c181", "address": "fa:16:3e:d6:d7:ba", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039ecba8-67", "ovs_interfaceid": "039ecba8-673d-41c4-a5bd-f5671896c181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:22:48 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:22:48 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:22:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-903505246',display_name='tempest-TestStampPattern-server-903505246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-903505246',id=8,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4bTwZ/jGMekzeEcO14GzYK3DGdo+oNI7mA/YkJRKaAKcLzVE0FyC6M9scMJglXnoXkUOrevnkhp2qnhWOlMGwLE9qftr8ybB+0jBRxkTjyexl7VDlmRC5pzxifapKyKw==',key_name='tempest-TestStampPattern-1405244377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7d74130d4d417a93de352381229948',ramdisk_id='',reservation_id='r-94iwt0ct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1782553765',owner_user_name='tempest-TestStampPattern-1782553765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:44Z,user_data=None,user_id='d59314e79d0344a2943391c3c2ab628a',uuid=a528e600-7358-4b92-9b71-12759f405b38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "039ecba8-673d-41c4-a5bd-f5671896c181", "address": "fa:16:3e:d6:d7:ba", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039ecba8-67", "ovs_interfaceid": "039ecba8-673d-41c4-a5bd-f5671896c181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Converting VIF {"id": "039ecba8-673d-41c4-a5bd-f5671896c181", "address": "fa:16:3e:d6:d7:ba", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039ecba8-67", "ovs_interfaceid": "039ecba8-673d-41c4-a5bd-f5671896c181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d7:ba,bridge_name='br-int',has_traffic_filtering=True,id=039ecba8-673d-41c4-a5bd-f5671896c181,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039ecba8-67') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'pci_devices' on Instance uuid a528e600-7358-4b92-9b71-12759f405b38 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Successfully created port: 1585d729-d8e7-44e3-b0d6-2367ec0fb1cb {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:22:48 user nova-compute[71711]:   <uuid>a528e600-7358-4b92-9b71-12759f405b38</uuid>
Apr 12 06:22:48 user nova-compute[71711]:   <name>instance-00000008</name>
Apr 12 06:22:48 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:22:48 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:22:48 user nova-compute[71711]:   <metadata>
Apr 12 06:22:48 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:22:48 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:22:48 user nova-compute[71711]:       <nova:name>tempest-TestStampPattern-server-903505246</nova:name>
Apr 12 06:22:48 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:22:48</nova:creationTime>
Apr 12 06:22:48 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:22:48 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:22:48 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:22:48 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:22:48 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:22:48 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:22:48 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:22:48 user nova-compute[71711]:       <nova:owner>
Apr 12 06:22:48 user nova-compute[71711]:         <nova:user uuid="d59314e79d0344a2943391c3c2ab628a">tempest-TestStampPattern-1782553765-project-member</nova:user>
Apr 12 06:22:48 user nova-compute[71711]:         <nova:project uuid="5a7d74130d4d417a93de352381229948">tempest-TestStampPattern-1782553765</nova:project>
Apr 12 06:22:48 user nova-compute[71711]:       </nova:owner>
Apr 12 06:22:48 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:22:48 user nova-compute[71711]:       <nova:ports>
Apr 12 06:22:48 user nova-compute[71711]:         <nova:port uuid="039ecba8-673d-41c4-a5bd-f5671896c181">
Apr 12 06:22:48 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 06:22:48 user nova-compute[71711]:         </nova:port>
Apr 12 06:22:48 user nova-compute[71711]:       </nova:ports>
Apr 12 06:22:48 user nova-compute[71711]:     </nova:instance>
Apr 12 06:22:48 user nova-compute[71711]:   </metadata>
Apr 12 06:22:48 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:22:48 user nova-compute[71711]:     <system>
Apr 12 06:22:48 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:22:48 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:22:48 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:22:48 user nova-compute[71711]:       <entry name="serial">a528e600-7358-4b92-9b71-12759f405b38</entry>
Apr 12 06:22:48 user nova-compute[71711]:       <entry name="uuid">a528e600-7358-4b92-9b71-12759f405b38</entry>
Apr 12 06:22:48 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:22:48 user nova-compute[71711]:     </system>
Apr 12 06:22:48 user nova-compute[71711]:   </sysinfo>
Apr 12 06:22:48 user nova-compute[71711]:   <os>
Apr 12 06:22:48 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:22:48 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:22:48 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:22:48 user nova-compute[71711]:   </os>
Apr 12 06:22:48 user nova-compute[71711]:   <features>
Apr 12 06:22:48 user nova-compute[71711]:     <acpi/>
Apr 12 06:22:48 user nova-compute[71711]:     <apic/>
Apr 12 06:22:48 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:22:48 user nova-compute[71711]:   </features>
Apr 12 06:22:48 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:22:48 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:22:48 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:22:48 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:22:48 user nova-compute[71711]:   </clock>
Apr 12 06:22:48 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:22:48 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:22:48 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:22:48 user nova-compute[71711]:   </cpu>
Apr 12 06:22:48 user nova-compute[71711]:   <devices>
Apr 12 06:22:48 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:22:48 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:22:48 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk"/>
Apr 12 06:22:48 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:22:48 user nova-compute[71711]:     </disk>
Apr 12 06:22:48 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:22:48 user nova-compute[71711]:       <mac address="fa:16:3e:d6:d7:ba"/>
Apr 12 06:22:48 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:22:48 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:22:48 user nova-compute[71711]:       <target dev="tap039ecba8-67"/>
Apr 12 06:22:48 user nova-compute[71711]:     </interface>
Apr 12 06:22:48 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:22:48 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/console.log" append="off"/>
Apr 12 06:22:48 user nova-compute[71711]:     </serial>
Apr 12 06:22:48 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:22:48 user nova-compute[71711]:     <video>
Apr 12 06:22:48 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:22:48 user nova-compute[71711]:     </video>
Apr 12 06:22:48 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:22:48 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:22:48 user nova-compute[71711]:     </rng>
Apr 12 06:22:48 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:22:48 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:22:48 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:22:48 user nova-compute[71711]:     </memballoon>
Apr 12 06:22:48 user nova-compute[71711]:   </devices>
Apr 12 06:22:48 user nova-compute[71711]: </domain>
Apr 12 06:22:48 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:22:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-903505246',display_name='tempest-TestStampPattern-server-903505246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-903505246',id=8,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4bTwZ/jGMekzeEcO14GzYK3DGdo+oNI7mA/YkJRKaAKcLzVE0FyC6M9scMJglXnoXkUOrevnkhp2qnhWOlMGwLE9qftr8ybB+0jBRxkTjyexl7VDlmRC5pzxifapKyKw==',key_name='tempest-TestStampPattern-1405244377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7d74130d4d417a93de352381229948',ramdisk_id='',reservation_id='r-94iwt0ct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1782553765',owner_user_name='tempest-TestStampPattern-1782553765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:44Z,user_data=None,user_id='d59314e79d0344a2943391c3c2ab628a',uuid=a528e600-7358-4b92-9b71-12759f405b38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "039ecba8-673d-41c4-a5bd-f5671896c181", "address": "fa:16:3e:d6:d7:ba", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039ecba8-67", "ovs_interfaceid": "039ecba8-673d-41c4-a5bd-f5671896c181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Converting VIF {"id": "039ecba8-673d-41c4-a5bd-f5671896c181", "address": "fa:16:3e:d6:d7:ba", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039ecba8-67", "ovs_interfaceid": "039ecba8-673d-41c4-a5bd-f5671896c181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d7:ba,bridge_name='br-int',has_traffic_filtering=True,id=039ecba8-673d-41c4-a5bd-f5671896c181,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039ecba8-67') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG os_vif [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d7:ba,bridge_name='br-int',has_traffic_filtering=True,id=039ecba8-673d-41c4-a5bd-f5671896c181,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039ecba8-67') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap039ecba8-67, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap039ecba8-67, col_values=(('external_ids', {'iface-id': '039ecba8-673d-41c4-a5bd-f5671896c181', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:d7:ba', 'vm-uuid': 'a528e600-7358-4b92-9b71-12759f405b38'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:48 user nova-compute[71711]: INFO os_vif [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:d7:ba,bridge_name='br-int',has_traffic_filtering=True,id=039ecba8-673d-41c4-a5bd-f5671896c181,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039ecba8-67')
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:22:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] No VIF found with MAC fa:16:3e:d6:d7:ba, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:22:49 user nova-compute[71711]: DEBUG nova.network.neutron [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Updated VIF entry in instance network info cache for port 039ecba8-673d-41c4-a5bd-f5671896c181. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:22:49 user nova-compute[71711]: DEBUG nova.network.neutron [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Updating instance_info_cache with network_info: [{"id": "039ecba8-673d-41c4-a5bd-f5671896c181", "address": "fa:16:3e:d6:d7:ba", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039ecba8-67", "ovs_interfaceid": "039ecba8-673d-41c4-a5bd-f5671896c181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-64ae4ddf-4d95-4b71-812d-595a2d5df90d req-78dd7af1-4ca3-40db-9ad7-f1825ad0c30d service nova] Releasing lock "refresh_cache-a528e600-7358-4b92-9b71-12759f405b38" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:49 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Successfully created port: 22b7b070-9ef1-402f-8cbc-50684b0dad1c {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:22:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:50 user nova-compute[71711]: DEBUG nova.compute.manager [req-bedb950e-0f25-4785-bc69-42e1e91e7a24 req-99973319-8c94-4265-913b-bbb6de4c11f2 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Received event network-vif-plugged-039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bedb950e-0f25-4785-bc69-42e1e91e7a24 req-99973319-8c94-4265-913b-bbb6de4c11f2 service nova] Acquiring lock "a528e600-7358-4b92-9b71-12759f405b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bedb950e-0f25-4785-bc69-42e1e91e7a24 req-99973319-8c94-4265-913b-bbb6de4c11f2 service nova] Lock "a528e600-7358-4b92-9b71-12759f405b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bedb950e-0f25-4785-bc69-42e1e91e7a24 req-99973319-8c94-4265-913b-bbb6de4c11f2 service nova] Lock "a528e600-7358-4b92-9b71-12759f405b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:50 user nova-compute[71711]: DEBUG nova.compute.manager [req-bedb950e-0f25-4785-bc69-42e1e91e7a24 req-99973319-8c94-4265-913b-bbb6de4c11f2 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] No waiting events found dispatching network-vif-plugged-039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:22:50 user nova-compute[71711]: WARNING nova.compute.manager [req-bedb950e-0f25-4785-bc69-42e1e91e7a24 req-99973319-8c94-4265-913b-bbb6de4c11f2 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Received unexpected event network-vif-plugged-039ecba8-673d-41c4-a5bd-f5671896c181 for instance with vm_state building and task_state spawning.
Apr 12 06:22:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:50 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Successfully updated port: 55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:22:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:51 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Successfully updated port: 48b06cf1-3d27-423d-a0fb-952c396a727c {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280572.2678185, a528e600-7358-4b92-9b71-12759f405b38 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:22:52 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: a528e600-7358-4b92-9b71-12759f405b38] VM Resumed (Lifecycle Event)
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:22:52 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: a528e600-7358-4b92-9b71-12759f405b38] Instance spawned successfully.
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: a528e600-7358-4b92-9b71-12759f405b38] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: a528e600-7358-4b92-9b71-12759f405b38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:22:52 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: a528e600-7358-4b92-9b71-12759f405b38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280572.2694712, a528e600-7358-4b92-9b71-12759f405b38 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:22:52 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: a528e600-7358-4b92-9b71-12759f405b38] VM Started (Lifecycle Event)
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: a528e600-7358-4b92-9b71-12759f405b38] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: a528e600-7358-4b92-9b71-12759f405b38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:22:52 user nova-compute[71711]: INFO nova.compute.manager [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Took 7.92 seconds to spawn the instance on the hypervisor.
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:22:52 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: a528e600-7358-4b92-9b71-12759f405b38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Successfully updated port: 1684f1e7-b9c2-4228-8809-ebaae1ed41c7 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:22:52 user nova-compute[71711]: INFO nova.compute.manager [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Took 9.26 seconds to build instance.
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.compute.manager [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-changed-55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.compute.manager [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing instance network info cache due to event network-changed-55fc6a3a-a62f-406f-9583-f4168544b133. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Acquiring lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Acquired lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.network.neutron [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing network info cache for port 55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d04a3d5-c3d1-4cb0-ad74-50b8594bdf72 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "a528e600-7358-4b92-9b71-12759f405b38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.388s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:52 user nova-compute[71711]: DEBUG nova.network.neutron [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:22:52 user nova-compute[71711]: INFO nova.virt.block_device [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Booting with volume 3d1bda7d-311d-45ff-9270-f1f4126818f3 at /dev/vdb
Apr 12 06:22:53 user nova-compute[71711]: DEBUG os_brick.utils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a12bc40-6c8b-4ac5-b180-a6672f7c2154]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[93849bcf-b651-4f95-80da-55f83de0f210]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[700f24c1-5b51-413b-a516-a19b2f80ea0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d22e3e3-6a82-4432-9258-0e4128c0c262]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:22:53 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a050e50d-6454-41a1-8992-be575d4c5988]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG os_brick.utils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating existing volume attachment record: 261ff49c-2a93-46e3-9267-ec53612a848a {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG nova.network.neutron [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Releasing lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Received event network-vif-plugged-039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Acquiring lock "a528e600-7358-4b92-9b71-12759f405b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Lock "a528e600-7358-4b92-9b71-12759f405b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Lock "a528e600-7358-4b92-9b71-12759f405b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] No waiting events found dispatching network-vif-plugged-039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:22:53 user nova-compute[71711]: WARNING nova.compute.manager [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Received unexpected event network-vif-plugged-039ecba8-673d-41c4-a5bd-f5671896c181 for instance with vm_state active and task_state None.
Apr 12 06:22:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-changed-48b06cf1-3d27-423d-a0fb-952c396a727c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing instance network info cache due to event network-changed-48b06cf1-3d27-423d-a0fb-952c396a727c. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Acquiring lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Acquired lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG nova.network.neutron [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing network info cache for port 48b06cf1-3d27-423d-a0fb-952c396a727c {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Successfully updated port: f984771f-43c1-4565-8e7f-34d142b19801 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG nova.network.neutron [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG nova.network.neutron [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5116fd40-3cc2-42c8-8510-e6538386dbe0 req-8e97c7de-895e-44a7-a017-fca24828d0e1 service nova] Releasing lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Successfully updated port: 6ee43811-1303-4a84-8bd4-0de882daac34 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:22:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-changed-1684f1e7-b9c2-4228-8809-ebaae1ed41c7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing instance network info cache due to event network-changed-1684f1e7-b9c2-4228-8809-ebaae1ed41c7. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:22:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Acquiring lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Acquired lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:54 user nova-compute[71711]: DEBUG nova.network.neutron [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing network info cache for port 1684f1e7-b9c2-4228-8809-ebaae1ed41c7 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:22:54 user nova-compute[71711]: DEBUG nova.network.neutron [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG nova.network.neutron [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Releasing lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-changed-f984771f-43c1-4565-8e7f-34d142b19801 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing instance network info cache due to event network-changed-f984771f-43c1-4565-8e7f-34d142b19801. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Acquiring lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Acquired lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG nova.network.neutron [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing network info cache for port f984771f-43c1-4565-8e7f-34d142b19801 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG nova.network.neutron [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Successfully updated port: 1585d729-d8e7-44e3-b0d6-2367ec0fb1cb {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG nova.network.neutron [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Releasing lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-changed-6ee43811-1303-4a84-8bd4-0de882daac34 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing instance network info cache due to event network-changed-6ee43811-1303-4a84-8bd4-0de882daac34. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Acquiring lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Acquired lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG nova.network.neutron [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing network info cache for port 6ee43811-1303-4a84-8bd4-0de882daac34 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG nova.network.neutron [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG nova.network.neutron [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7b612e35-903e-4f3c-a784-bba80ce17793 req-ba2c6f4b-2e66-41c7-a558-cf42866a5bad service nova] Releasing lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Successfully updated port: 22b7b070-9ef1-402f-8cbc-50684b0dad1c {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:22:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquired lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:22:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:22:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-changed-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing instance network info cache due to event network-changed-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:22:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] Acquiring lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:58 user nova-compute[71711]: INFO nova.virt.block_device [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Booting with volume 19059339-d01d-43bc-9939-181649d28bc6 at /dev/vdc
Apr 12 06:22:58 user nova-compute[71711]: DEBUG os_brick.utils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7f4ae5-e788-4d7c-aa3f-2dcd34e7857d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd74e20-a7f4-4ba2-b02f-cfd7496f3656]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e0e1ac-fd06-42fa-937d-83a05833b829]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c876615-0c06-4076-9ffd-cb062254f798]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating instance_info_cache with network_info: [{"id": "55fc6a3a-a62f-406f-9583-f4168544b133", "address": "fa:16:3e:d3:88:42", "network": {"id": "6c8f984a-0a0e-4909-9a98-c4055a889b2b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-51661518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fc6a3a-a6", "ovs_interfaceid": "55fc6a3a-a62f-406f-9583-f4168544b133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48b06cf1-3d27-423d-a0fb-952c396a727c", "address": "fa:16:3e:e5:98:cb", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b06cf1-3d", "ovs_interfaceid": "48b06cf1-3d27-423d-a0fb-952c396a727c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "address": "fa:16:3e:13:66:36", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1684f1e7-b9", "ovs_interfaceid": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f984771f-43c1-4565-8e7f-34d142b19801", "address": "fa:16:3e:cf:c5:ab", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf984771f-43", "ovs_interfaceid": "f984771f-43c1-4565-8e7f-34d142b19801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ee43811-1303-4a84-8bd4-0de882daac34", "address": "fa:16:3e:37:23:e2", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee43811-13", "ovs_interfaceid": "6ee43811-1303-4a84-8bd4-0de882daac34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "address": "fa:16:3e:e5:63:8c", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1585d729-d8", "ovs_interfaceid": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "address": "fa:16:3e:0b:4f:d7", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b7b070-9e", "ovs_interfaceid": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:22:58 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ec71e0-68b6-49d0-93c8-790bdd713e43]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG os_brick.utils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating existing volume attachment record: 0da574b5-fbcf-4265-9cd4-d6fc0a79d05c {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Releasing lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Instance network_info: |[{"id": "55fc6a3a-a62f-406f-9583-f4168544b133", "address": "fa:16:3e:d3:88:42", "network": {"id": "6c8f984a-0a0e-4909-9a98-c4055a889b2b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-51661518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fc6a3a-a6", "ovs_interfaceid": "55fc6a3a-a62f-406f-9583-f4168544b133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48b06cf1-3d27-423d-a0fb-952c396a727c", "address": "fa:16:3e:e5:98:cb", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b06cf1-3d", "ovs_interfaceid": "48b06cf1-3d27-423d-a0fb-952c396a727c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "address": "fa:16:3e:13:66:36", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1684f1e7-b9", "ovs_interfaceid": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f984771f-43c1-4565-8e7f-34d142b19801", "address": "fa:16:3e:cf:c5:ab", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf984771f-43", "ovs_interfaceid": "f984771f-43c1-4565-8e7f-34d142b19801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ee43811-1303-4a84-8bd4-0de882daac34", "address": "fa:16:3e:37:23:e2", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee43811-13", "ovs_interfaceid": "6ee43811-1303-4a84-8bd4-0de882daac34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "address": "fa:16:3e:e5:63:8c", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1585d729-d8", "ovs_interfaceid": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "address": "fa:16:3e:0b:4f:d7", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b7b070-9e", "ovs_interfaceid": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] Acquired lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:58 user nova-compute[71711]: DEBUG nova.network.neutron [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing network info cache for port 1585d729-d8e7-44e3-b0d6-2367ec0fb1cb {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:22:59 user nova-compute[71711]: DEBUG nova.network.neutron [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updated VIF entry in instance network info cache for port 1585d729-d8e7-44e3-b0d6-2367ec0fb1cb. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:22:59 user nova-compute[71711]: DEBUG nova.network.neutron [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating instance_info_cache with network_info: [{"id": "55fc6a3a-a62f-406f-9583-f4168544b133", "address": "fa:16:3e:d3:88:42", "network": {"id": "6c8f984a-0a0e-4909-9a98-c4055a889b2b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-51661518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fc6a3a-a6", "ovs_interfaceid": "55fc6a3a-a62f-406f-9583-f4168544b133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48b06cf1-3d27-423d-a0fb-952c396a727c", "address": "fa:16:3e:e5:98:cb", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b06cf1-3d", "ovs_interfaceid": "48b06cf1-3d27-423d-a0fb-952c396a727c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "address": "fa:16:3e:13:66:36", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1684f1e7-b9", "ovs_interfaceid": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f984771f-43c1-4565-8e7f-34d142b19801", "address": "fa:16:3e:cf:c5:ab", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf984771f-43", "ovs_interfaceid": "f984771f-43c1-4565-8e7f-34d142b19801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ee43811-1303-4a84-8bd4-0de882daac34", "address": "fa:16:3e:37:23:e2", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee43811-13", "ovs_interfaceid": "6ee43811-1303-4a84-8bd4-0de882daac34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "address": "fa:16:3e:e5:63:8c", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1585d729-d8", "ovs_interfaceid": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "address": "fa:16:3e:0b:4f:d7", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b7b070-9e", "ovs_interfaceid": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] Releasing lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:22:59 user nova-compute[71711]: DEBUG nova.compute.manager [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-changed-22b7b070-9ef1-402f-8cbc-50684b0dad1c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:22:59 user nova-compute[71711]: DEBUG nova.compute.manager [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing instance network info cache due to event network-changed-22b7b070-9ef1-402f-8cbc-50684b0dad1c. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:22:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] Acquiring lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:22:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] Acquired lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:22:59 user nova-compute[71711]: DEBUG nova.network.neutron [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing network info cache for port 22b7b070-9ef1-402f-8cbc-50684b0dad1c {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:22:59 user nova-compute[71711]: DEBUG nova.network.neutron [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updated VIF entry in instance network info cache for port 22b7b070-9ef1-402f-8cbc-50684b0dad1c. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:22:59 user nova-compute[71711]: DEBUG nova.network.neutron [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating instance_info_cache with network_info: [{"id": "55fc6a3a-a62f-406f-9583-f4168544b133", "address": "fa:16:3e:d3:88:42", "network": {"id": "6c8f984a-0a0e-4909-9a98-c4055a889b2b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-51661518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fc6a3a-a6", "ovs_interfaceid": "55fc6a3a-a62f-406f-9583-f4168544b133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48b06cf1-3d27-423d-a0fb-952c396a727c", "address": "fa:16:3e:e5:98:cb", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b06cf1-3d", "ovs_interfaceid": "48b06cf1-3d27-423d-a0fb-952c396a727c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "address": "fa:16:3e:13:66:36", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1684f1e7-b9", "ovs_interfaceid": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f984771f-43c1-4565-8e7f-34d142b19801", "address": "fa:16:3e:cf:c5:ab", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf984771f-43", "ovs_interfaceid": "f984771f-43c1-4565-8e7f-34d142b19801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ee43811-1303-4a84-8bd4-0de882daac34", "address": "fa:16:3e:37:23:e2", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee43811-13", "ovs_interfaceid": "6ee43811-1303-4a84-8bd4-0de882daac34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "address": "fa:16:3e:e5:63:8c", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1585d729-d8", "ovs_interfaceid": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "address": "fa:16:3e:0b:4f:d7", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b7b070-9e", "ovs_interfaceid": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:22:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-51ad2aea-737e-480b-b484-f38dd8d13a86 req-d84042e8-fbc4-4c7d-aef7-92947ec00904 service nova] Releasing lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:23:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:23:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:23:01 user nova-compute[71711]: INFO nova.compute.claims [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Claim successful on node user
Apr 12 06:23:01 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG nova.network.neutron [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:23:01 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:23:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:23:01 user nova-compute[71711]: INFO nova.virt.block_device [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Booting with volume d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a at /dev/vda
Apr 12 06:23:01 user nova-compute[71711]: DEBUG nova.policy [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ed3a446901644b6a622afb3166f08dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7742afa38eb46818efaf3b811c417ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG os_brick.utils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2124de76-b6a0-4856-8602-a219e464da01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c824aeb-de5f-4dc4-b94f-2d3a4bf487f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcac967-c258-44a4-81a2-db0794754cb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[31930fcb-7f71-4610-96f4-c4de8c5276b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:23:01 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:23:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[effa7aab-aad4-4be9-8428-899058c37bf1]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG os_brick.utils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:23:01 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updating existing volume attachment record: 49b30f8f-e996-4b85-8960-ff1be3fb4a63 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:23:02 user nova-compute[71711]: DEBUG nova.network.neutron [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Successfully created port: f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.network.neutron [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Successfully updated port: f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquired lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.network.neutron [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.compute.manager [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-changed-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.compute.manager [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Refreshing instance network info cache due to event network-changed-f2b23249-b032-47f5-973e-922f210b40b2. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] Acquiring lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.network.neutron [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:23:03 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Creating image(s)
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Ensure instance console log exists: /opt/stack/data/nova/instances/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Start _get_guest_xml network_info=[{"id": "55fc6a3a-a62f-406f-9583-f4168544b133", "address": "fa:16:3e:d3:88:42", "network": {"id": "6c8f984a-0a0e-4909-9a98-c4055a889b2b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-51661518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fc6a3a-a6", "ovs_interfaceid": "55fc6a3a-a62f-406f-9583-f4168544b133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48b06cf1-3d27-423d-a0fb-952c396a727c", "address": "fa:16:3e:e5:98:cb", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b06cf1-3d", "ovs_interfaceid": "48b06cf1-3d27-423d-a0fb-952c396a727c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "address": "fa:16:3e:13:66:36", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1684f1e7-b9", "ovs_interfaceid": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f984771f-43c1-4565-8e7f-34d142b19801", "address": "fa:16:3e:cf:c5:ab", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf984771f-43", "ovs_interfaceid": "f984771f-43c1-4565-8e7f-34d142b19801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ee43811-1303-4a84-8bd4-0de882daac34", "address": "fa:16:3e:37:23:e2", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee43811-13", "ovs_interfaceid": "6ee43811-1303-4a84-8bd4-0de882daac34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "address": "fa:16:3e:e5:63:8c", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1585d729-d8", "ovs_interfaceid": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "address": "fa:16:3e:0b:4f:d7", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b7b070-9e", "ovs_interfaceid": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PptcCjqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7133ac6b-6627-4aaa-86f9-9ac3c8f8139b', 'attached_at': '', 'detached_at': '', 'volume_id': '6938de6c-91d6-44b2-af51-33e34e241f29', 'serial': '6938de6c-91d6-44b2-af51-33e34e241f29'}, 'attachment_id': '7de96b37-b23a-4ffb-a822-75cc529fde57', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'device_type': 'disk', 'boot_index': 1, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjSIiUbK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7133ac6b-6627-4aaa-86f9-9ac3c8f8139b', 'attached_at': '', 'detached_at': '', 'volume_id': '3d1bda7d-311d-45ff-9270-f1f4126818f3', 'serial': '3d1bda7d-311d-45ff-9270-f1f4126818f3'}, 'attachment_id': '261ff49c-2a93-46e3-9267-ec53612a848a', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'device_type': 'disk', 'boot_index': 2, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdTKAgwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7133ac6b-6627-4aaa-86f9-9ac3c8f8139b', 'attached_at': '', 'detached_at': '', 'volume_id': '19059339-d01d-43bc-9939-181649d28bc6', 'serial': '19059339-d01d-43bc-9939-181649d28bc6'}, 'attachment_id': '0da574b5-fbcf-4265-9cd4-d6fc0a79d05c', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:03 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:23:03 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connector [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Factory for ISCSI on None {{(pid=71711) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PptcCjqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:23:03 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:23:03 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:23:03 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f949229-9d3e-4fc6-ab07-dcc6c8a5f68d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:23:03 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ea93e4-7fd6-4825-b144-3bb73bad60b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29] added
Apr 12 06:23:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d73e7b3-fb73-48cf-a376-2858828127b7]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7581a62-5b29-4cd2-b072-3679cabf2f1b]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PptcCjqG {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PptcCjqG" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[972c612c-292b-4296-a68e-691f3b7beced]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PptcCjqG'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72144e1-0758-4c0e-9309-008e816e2122]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[db45e8cd-b9c0-4416-870d-0f218b594431]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:23:03 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:23:03 user nova-compute[71711]:  {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:23:03 user nova-compute[71711]: WARNING os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 06:23:03 user nova-compute[71711]: 
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a283972-471d-4ab9-b2f7-816a0abedaca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260]
Apr 12 06:23:03 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260] successful.
Apr 12 06:23:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[008daf7c-6977-407d-b888-86cb48445c32]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.network.neutron [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updating instance_info_cache with network_info: [{"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9841026-4911-45d0-9d00-6b0f1e9a7c06]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Releasing lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.compute.manager [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Instance network_info: |[{"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] Acquired lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG nova.network.neutron [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Refreshing network info cache for port f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.034s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfb165b-91b1-423c-99c9-8aeafff96802]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:23:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PptcCjqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:23:04 user nova-compute[71711]: DEBUG nova.network.neutron [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updated VIF entry in instance network info cache for port f2b23249-b032-47f5-973e-922f210b40b2. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:23:04 user nova-compute[71711]: DEBUG nova.network.neutron [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updating instance_info_cache with network_info: [{"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:23:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5c5146a8-4f28-4fc9-b9d0-03e7ad5babb3 req-3e410216-edfb-4370-b164-0d8b8ad629bb service nova] Releasing lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:23:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:23:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26635346137396436', 'path': '/dev/sdb'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:23:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635346137396436', 'path': '/dev/sdb'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:23:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:23:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjSIiUbK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:23:04 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:23:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:23:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:23:04 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:23:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:23:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:23:04 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:23:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3c85f5-01bb-4e59-a1e0-73c64da30538]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:23:05 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb13b801-57d6-4169-a4d9-fa0dcf8bf81d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3] added
Apr 12 06:23:05 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b491fd-c2ee-4b7f-b796-a5d7a66e464e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2060283-a37a-4a14-968f-0f09026d3c8c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjSIiUbK {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjSIiUbK" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fc62fe-173d-4ee2-bb5a-d70ab182737b]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TjSIiUbK'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[440ec44d-e449-4b33-bcce-ec0575c861e1]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[28239995-6b16-4f2f-8f65-9d9c95ba3d5e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:05 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:05 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd83b2b-0564-4d1c-823b-a4472b96d7a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3, portal: 172.16.0.220,3260]
Apr 12 06:23:05 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3, portal: 172.16.0.220,3260] successful.
Apr 12 06:23:05 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[498b6130-dbc9-4f60-ada0-7a0f8a32bff6]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fbd5c6-8e41-493f-af9b-effa45824a46]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:05 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:05 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:05 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:05 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab176a8f-8280-47b1-b1cb-cc6762bc01d8]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:23:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjSIiUbK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26436303030663539', 'path': '/dev/sdc'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436303030663539', 'path': '/dev/sdc'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdTKAgwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:23:06 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:23:06 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:23:06 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5945e0cb-0823-4132-81a1-fe2a67c03756]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:23:06 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c705ca3-7891-4165-8ac7-bbf41030d2a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6] added
Apr 12 06:23:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffa8276-ceb5-416f-b2ee-145643144216]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.compute.manager [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:23:06 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Creating image(s)
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Ensure instance console log exists: /opt/stack/data/nova/instances/7141c80d-34a9-40cc-a792-b01ffd9155b6/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Start _get_guest_xml network_info=[{"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcOxDrPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7141c80d-34a9-40cc-a792-b01ffd9155b6', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'serial': 'd3ef3a9b-2394-48ed-a2a6-e85ab6076c8a'}, 'attachment_id': '49b30f8f-e996-4b85-8960-ff1be3fb4a63', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:06 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:23:06 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcOxDrPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:23:06 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[af724db3-efcb-49ac-8523-78af10e383c8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdTKAgwm {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdTKAgwm" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b629730f-4e59-4b8a-a324-02242e9e563d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CdTKAgwm'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fab931-5cda-43ae-bebb-e2943c0c85bb]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5704ad-0718-426a-a406-0fc717396dfd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:06 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:06 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[806bd64d-0b8b-46dd-a7b0-d0f32b0a92a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6, portal: 172.16.0.220,3260]
Apr 12 06:23:06 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6, portal: 172.16.0.220,3260] successful.
Apr 12 06:23:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cad73b7-50c5-40d9-902a-3bbb847d6174]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[674bd1ec-719e-41a1-a291-42e73a112327]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:06 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:06 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:06 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:06 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8630a98d-6a2a-4730-b741-6107970f9c17]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:06 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdTKAgwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23634636638653330', 'path': '/dev/sdd'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634636638653330', 'path': '/dev/sdd'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.226s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:23:07 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:23:07 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55fc6a3a-a62f-406f-9583-f4168544b133", "address": "fa:16:3e:d3:88:42", "network": {"id": "6c8f984a-0a0e-4909-9a98-c4055a889b2b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-51661518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fc6a3a-a6", "ovs_interfaceid": "55fc6a3a-a62f-406f-9583-f4168544b133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "55fc6a3a-a62f-406f-9583-f4168544b133", "address": "fa:16:3e:d3:88:42", "network": {"id": "6c8f984a-0a0e-4909-9a98-c4055a889b2b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-51661518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fc6a3a-a6", "ovs_interfaceid": "55fc6a3a-a62f-406f-9583-f4168544b133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:88:42,bridge_name='br-int',has_traffic_filtering=True,id=55fc6a3a-a62f-406f-9583-f4168544b133,network=Network(6c8f984a-0a0e-4909-9a98-c4055a889b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fc6a3a-a6') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48b06cf1-3d27-423d-a0fb-952c396a727c", "address": "fa:16:3e:e5:98:cb", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b06cf1-3d", "ovs_interfaceid": "48b06cf1-3d27-423d-a0fb-952c396a727c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "48b06cf1-3d27-423d-a0fb-952c396a727c", "address": "fa:16:3e:e5:98:cb", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b06cf1-3d", "ovs_interfaceid": "48b06cf1-3d27-423d-a0fb-952c396a727c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:98:cb,bridge_name='br-int',has_traffic_filtering=True,id=48b06cf1-3d27-423d-a0fb-952c396a727c,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48b06cf1-3d') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "address": "fa:16:3e:13:66:36", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1684f1e7-b9", "ovs_interfaceid": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "address": "fa:16:3e:13:66:36", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1684f1e7-b9", "ovs_interfaceid": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:66:36,bridge_name='br-int',has_traffic_filtering=True,id=1684f1e7-b9c2-4228-8809-ebaae1ed41c7,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1684f1e7-b9') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f984771f-43c1-4565-8e7f-34d142b19801", "address": "fa:16:3e:cf:c5:ab", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf984771f-43", "ovs_interfaceid": "f984771f-43c1-4565-8e7f-34d142b19801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "f984771f-43c1-4565-8e7f-34d142b19801", "address": "fa:16:3e:cf:c5:ab", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf984771f-43", "ovs_interfaceid": "f984771f-43c1-4565-8e7f-34d142b19801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c5:ab,bridge_name='br-int',has_traffic_filtering=True,id=f984771f-43c1-4565-8e7f-34d142b19801,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf984771f-43') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ee43811-1303-4a84-8bd4-0de882daac34", "address": "fa:16:3e:37:23:e2", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee43811-13", "ovs_interfaceid": "6ee43811-1303-4a84-8bd4-0de882daac34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "6ee43811-1303-4a84-8bd4-0de882daac34", "address": "fa:16:3e:37:23:e2", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee43811-13", "ovs_interfaceid": "6ee43811-1303-4a84-8bd4-0de882daac34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ee43811-1303-4a84-8bd4-0de882daac34,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee43811-13') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "address": "fa:16:3e:e5:63:8c", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1585d729-d8", "ovs_interfaceid": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "address": "fa:16:3e:e5:63:8c", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1585d729-d8", "ovs_interfaceid": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:63:8c,bridge_name='br-int',has_traffic_filtering=True,id=1585d729-d8e7-44e3-b0d6-2367ec0fb1cb,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1585d729-d8') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "address": "fa:16:3e:0b:4f:d7", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b7b070-9e", "ovs_interfaceid": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "address": "fa:16:3e:0b:4f:d7", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b7b070-9e", "ovs_interfaceid": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=22b7b070-9ef1-402f-8cbc-50684b0dad1c,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b7b070-9e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.objects.instance [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lazy-loading 'pci_devices' on Instance uuid 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c69387b-661e-4443-b944-e938c708f8a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:23:07 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:23:07 user nova-compute[71711]:   <uuid>7133ac6b-6627-4aaa-86f9-9ac3c8f8139b</uuid>
Apr 12 06:23:07 user nova-compute[71711]:   <name>instance-00000009</name>
Apr 12 06:23:07 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:23:07 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:23:07 user nova-compute[71711]:   <metadata>
Apr 12 06:23:07 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:23:07 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:23:07 user nova-compute[71711]:       <nova:name>tempest-device-tagging-server-235005928</nova:name>
Apr 12 06:23:07 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:23:03</nova:creationTime>
Apr 12 06:23:07 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:23:07 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:23:07 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:23:07 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:23:07 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:23:07 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:23:07 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:23:07 user nova-compute[71711]:       <nova:owner>
Apr 12 06:23:07 user nova-compute[71711]:         <nova:user uuid="977b800fab264446b0492c93b0dc12d3">tempest-TaggedBootDevicesTest_v242-1197354508-project-member</nova:user>
Apr 12 06:23:07 user nova-compute[71711]:         <nova:project uuid="e313922ba234462285d20a4f1f2d88d0">tempest-TaggedBootDevicesTest_v242-1197354508</nova:project>
Apr 12 06:23:07 user nova-compute[71711]:       </nova:owner>
Apr 12 06:23:07 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:23:07 user nova-compute[71711]:       <nova:ports>
Apr 12 06:23:07 user nova-compute[71711]:         <nova:port uuid="55fc6a3a-a62f-406f-9583-f4168544b133">
Apr 12 06:23:07 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 06:23:07 user nova-compute[71711]:         </nova:port>
Apr 12 06:23:07 user nova-compute[71711]:         <nova:port uuid="48b06cf1-3d27-423d-a0fb-952c396a727c">
Apr 12 06:23:07 user nova-compute[71711]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Apr 12 06:23:07 user nova-compute[71711]:         </nova:port>
Apr 12 06:23:07 user nova-compute[71711]:         <nova:port uuid="1684f1e7-b9c2-4228-8809-ebaae1ed41c7">
Apr 12 06:23:07 user nova-compute[71711]:           <nova:ip type="fixed" address="10.1.1.149" ipVersion="4"/>
Apr 12 06:23:07 user nova-compute[71711]:         </nova:port>
Apr 12 06:23:07 user nova-compute[71711]:         <nova:port uuid="f984771f-43c1-4565-8e7f-34d142b19801">
Apr 12 06:23:07 user nova-compute[71711]:           <nova:ip type="fixed" address="10.1.1.36" ipVersion="4"/>
Apr 12 06:23:07 user nova-compute[71711]:         </nova:port>
Apr 12 06:23:07 user nova-compute[71711]:         <nova:port uuid="6ee43811-1303-4a84-8bd4-0de882daac34">
Apr 12 06:23:07 user nova-compute[71711]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Apr 12 06:23:07 user nova-compute[71711]:         </nova:port>
Apr 12 06:23:07 user nova-compute[71711]:         <nova:port uuid="1585d729-d8e7-44e3-b0d6-2367ec0fb1cb">
Apr 12 06:23:07 user nova-compute[71711]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 06:23:07 user nova-compute[71711]:         </nova:port>
Apr 12 06:23:07 user nova-compute[71711]:         <nova:port uuid="22b7b070-9ef1-402f-8cbc-50684b0dad1c">
Apr 12 06:23:07 user nova-compute[71711]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 06:23:07 user nova-compute[71711]:         </nova:port>
Apr 12 06:23:07 user nova-compute[71711]:       </nova:ports>
Apr 12 06:23:07 user nova-compute[71711]:     </nova:instance>
Apr 12 06:23:07 user nova-compute[71711]:   </metadata>
Apr 12 06:23:07 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:23:07 user nova-compute[71711]:     <system>
Apr 12 06:23:07 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:23:07 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:23:07 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:23:07 user nova-compute[71711]:       <entry name="serial">7133ac6b-6627-4aaa-86f9-9ac3c8f8139b</entry>
Apr 12 06:23:07 user nova-compute[71711]:       <entry name="uuid">7133ac6b-6627-4aaa-86f9-9ac3c8f8139b</entry>
Apr 12 06:23:07 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:23:07 user nova-compute[71711]:     </system>
Apr 12 06:23:07 user nova-compute[71711]:   </sysinfo>
Apr 12 06:23:07 user nova-compute[71711]:   <os>
Apr 12 06:23:07 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:23:07 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:23:07 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:23:07 user nova-compute[71711]:   </os>
Apr 12 06:23:07 user nova-compute[71711]:   <features>
Apr 12 06:23:07 user nova-compute[71711]:     <acpi/>
Apr 12 06:23:07 user nova-compute[71711]:     <apic/>
Apr 12 06:23:07 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:23:07 user nova-compute[71711]:   </features>
Apr 12 06:23:07 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:23:07 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:23:07 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:23:07 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:23:07 user nova-compute[71711]:   </clock>
Apr 12 06:23:07 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:23:07 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:23:07 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:23:07 user nova-compute[71711]:   </cpu>
Apr 12 06:23:07 user nova-compute[71711]:   <devices>
Apr 12 06:23:07 user nova-compute[71711]:     <disk type="file" device="cdrom">
Apr 12 06:23:07 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 06:23:07 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b/disk.config"/>
Apr 12 06:23:07 user nova-compute[71711]:       <target dev="hda" bus="ide"/>
Apr 12 06:23:07 user nova-compute[71711]:     </disk>
Apr 12 06:23:07 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:23:07 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:23:07 user nova-compute[71711]:       <source dev="/dev/sdb"/>
Apr 12 06:23:07 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:23:07 user nova-compute[71711]:       <serial>6938de6c-91d6-44b2-af51-33e34e241f29</serial>
Apr 12 06:23:07 user nova-compute[71711]:     </disk>
Apr 12 06:23:07 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:23:07 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:23:07 user nova-compute[71711]:       <source dev="/dev/sdc"/>
Apr 12 06:23:07 user nova-compute[71711]:       <target dev="vdb" bus="virtio"/>
Apr 12 06:23:07 user nova-compute[71711]:       <serial>3d1bda7d-311d-45ff-9270-f1f4126818f3</serial>
Apr 12 06:23:07 user nova-compute[71711]:     </disk>
Apr 12 06:23:07 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:23:07 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:23:07 user nova-compute[71711]:       <source dev="/dev/sdd"/>
Apr 12 06:23:07 user nova-compute[71711]:       <target dev="vdc" bus="virtio"/>
Apr 12 06:23:07 user nova-compute[71711]:       <serial>19059339-d01d-43bc-9939-181649d28bc6</serial>
Apr 12 06:23:07 user nova-compute[71711]:     </disk>
Apr 12 06:23:07 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:23:07 user nova-compute[71711]:       <mac address="fa:16:3e:d3:88:42"/>
Apr 12 06:23:07 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:23:07 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:23:07 user nova-compute[71711]:       <target dev="tap55fc6a3a-a6"/>
Apr 12 06:23:07 user nova-compute[71711]:     </interface>
Apr 12 06:23:07 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:23:07 user nova-compute[71711]:       <mac address="fa:16:3e:e5:98:cb"/>
Apr 12 06:23:07 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:23:07 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:23:07 user nova-compute[71711]:       <target dev="tap48b06cf1-3d"/>
Apr 12 06:23:07 user nova-compute[71711]:     </interface>
Apr 12 06:23:07 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:23:07 user nova-compute[71711]:       <mac address="fa:16:3e:13:66:36"/>
Apr 12 06:23:07 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:23:07 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:23:07 user nova-compute[71711]:       <target dev="tap1684f1e7-b9"/>
Apr 12 06:23:07 user nova-compute[71711]:     </interface>
Apr 12 06:23:07 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:23:07 user nova-compute[71711]:       <mac address="fa:16:3e:cf:c5:ab"/>
Apr 12 06:23:07 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:23:07 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:23:07 user nova-compute[71711]:       <target dev="tapf984771f-43"/>
Apr 12 06:23:07 user nova-compute[71711]:     </interface>
Apr 12 06:23:07 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:23:07 user nova-compute[71711]:       <mac address="fa:16:3e:37:23:e2"/>
Apr 12 06:23:07 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:23:07 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:23:07 user nova-compute[71711]:       <target dev="tap6ee43811-13"/>
Apr 12 06:23:07 user nova-compute[71711]:     </interface>
Apr 12 06:23:07 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:23:07 user nova-compute[71711]:       <mac address="fa:16:3e:e5:63:8c"/>
Apr 12 06:23:07 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:23:07 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:23:07 user nova-compute[71711]:       <target dev="tap1585d729-d8"/>
Apr 12 06:23:07 user nova-compute[71711]:     </interface>
Apr 12 06:23:07 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:23:07 user nova-compute[71711]:       <mac address="fa:16:3e:0b:4f:d7"/>
Apr 12 06:23:07 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:23:07 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:23:07 user nova-compute[71711]:       <target dev="tap22b7b070-9e"/>
Apr 12 06:23:07 user nova-compute[71711]:     </interface>
Apr 12 06:23:07 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:23:07 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b/console.log" append="off"/>
Apr 12 06:23:07 user nova-compute[71711]:     </serial>
Apr 12 06:23:07 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:23:07 user nova-compute[71711]:     <video>
Apr 12 06:23:07 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:23:07 user nova-compute[71711]:     </video>
Apr 12 06:23:07 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:23:07 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:23:07 user nova-compute[71711]:     </rng>
Apr 12 06:23:07 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:23:07 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:23:07 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:23:07 user nova-compute[71711]:     </memballoon>
Apr 12 06:23:07 user nova-compute[71711]:   </devices>
Apr 12 06:23:07 user nova-compute[71711]: </domain>
Apr 12 06:23:07 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55fc6a3a-a62f-406f-9583-f4168544b133", "address": "fa:16:3e:d3:88:42", "network": {"id": "6c8f984a-0a0e-4909-9a98-c4055a889b2b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-51661518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fc6a3a-a6", "ovs_interfaceid": "55fc6a3a-a62f-406f-9583-f4168544b133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "55fc6a3a-a62f-406f-9583-f4168544b133", "address": "fa:16:3e:d3:88:42", "network": {"id": "6c8f984a-0a0e-4909-9a98-c4055a889b2b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-51661518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fc6a3a-a6", "ovs_interfaceid": "55fc6a3a-a62f-406f-9583-f4168544b133", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:88:42,bridge_name='br-int',has_traffic_filtering=True,id=55fc6a3a-a62f-406f-9583-f4168544b133,network=Network(6c8f984a-0a0e-4909-9a98-c4055a889b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fc6a3a-a6') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:88:42,bridge_name='br-int',has_traffic_filtering=True,id=55fc6a3a-a62f-406f-9583-f4168544b133,network=Network(6c8f984a-0a0e-4909-9a98-c4055a889b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fc6a3a-a6') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b4c3c5-3fd0-4c9a-9d1f-d0aafee084a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a] added
Apr 12 06:23:07 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55fc6a3a-a6, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55fc6a3a-a6, col_values=(('external_ids', {'iface-id': '55fc6a3a-a62f-406f-9583-f4168544b133', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:88:42', 'vm-uuid': '7133ac6b-6627-4aaa-86f9-9ac3c8f8139b'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: INFO os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:88:42,bridge_name='br-int',has_traffic_filtering=True,id=55fc6a3a-a62f-406f-9583-f4168544b133,network=Network(6c8f984a-0a0e-4909-9a98-c4055a889b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fc6a3a-a6')
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48b06cf1-3d27-423d-a0fb-952c396a727c", "address": "fa:16:3e:e5:98:cb", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b06cf1-3d", "ovs_interfaceid": "48b06cf1-3d27-423d-a0fb-952c396a727c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "48b06cf1-3d27-423d-a0fb-952c396a727c", "address": "fa:16:3e:e5:98:cb", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b06cf1-3d", "ovs_interfaceid": "48b06cf1-3d27-423d-a0fb-952c396a727c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:98:cb,bridge_name='br-int',has_traffic_filtering=True,id=48b06cf1-3d27-423d-a0fb-952c396a727c,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48b06cf1-3d') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:98:cb,bridge_name='br-int',has_traffic_filtering=True,id=48b06cf1-3d27-423d-a0fb-952c396a727c,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48b06cf1-3d') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07b452c-c9b9-4cc9-88be-ed090538a55c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48b06cf1-3d, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48b06cf1-3d, col_values=(('external_ids', {'iface-id': '48b06cf1-3d27-423d-a0fb-952c396a727c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:98:cb', 'vm-uuid': '7133ac6b-6627-4aaa-86f9-9ac3c8f8139b'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[da89b819-0640-4d72-b7b4-d5dc9c0dd057]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bcOxDrPR {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: INFO os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:98:cb,bridge_name='br-int',has_traffic_filtering=True,id=48b06cf1-3d27-423d-a0fb-952c396a727c,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48b06cf1-3d')
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "address": "fa:16:3e:13:66:36", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1684f1e7-b9", "ovs_interfaceid": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "address": "fa:16:3e:13:66:36", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1684f1e7-b9", "ovs_interfaceid": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:66:36,bridge_name='br-int',has_traffic_filtering=True,id=1684f1e7-b9c2-4228-8809-ebaae1ed41c7,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1684f1e7-b9') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:66:36,bridge_name='br-int',has_traffic_filtering=True,id=1684f1e7-b9c2-4228-8809-ebaae1ed41c7,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1684f1e7-b9') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1684f1e7-b9, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1684f1e7-b9, col_values=(('external_ids', {'iface-id': '1684f1e7-b9c2-4228-8809-ebaae1ed41c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:66:36', 'vm-uuid': '7133ac6b-6627-4aaa-86f9-9ac3c8f8139b'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bcOxDrPR" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fed26b0-e2b0-4b4a-ae23-5de0ce38e7db]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bcOxDrPR'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d1d448-b9b6-4d10-8f37-0ec0d91f1567]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:07 user nova-compute[71711]: INFO os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:66:36,bridge_name='br-int',has_traffic_filtering=True,id=1684f1e7-b9c2-4228-8809-ebaae1ed41c7,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1684f1e7-b9')
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f984771f-43c1-4565-8e7f-34d142b19801", "address": "fa:16:3e:cf:c5:ab", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf984771f-43", "ovs_interfaceid": "f984771f-43c1-4565-8e7f-34d142b19801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "f984771f-43c1-4565-8e7f-34d142b19801", "address": "fa:16:3e:cf:c5:ab", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf984771f-43", "ovs_interfaceid": "f984771f-43c1-4565-8e7f-34d142b19801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c5:ab,bridge_name='br-int',has_traffic_filtering=True,id=f984771f-43c1-4565-8e7f-34d142b19801,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf984771f-43') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c5:ab,bridge_name='br-int',has_traffic_filtering=True,id=f984771f-43c1-4565-8e7f-34d142b19801,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf984771f-43') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf984771f-43, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf984771f-43, col_values=(('external_ids', {'iface-id': 'f984771f-43c1-4565-8e7f-34d142b19801', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:c5:ab', 'vm-uuid': '7133ac6b-6627-4aaa-86f9-9ac3c8f8139b'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef24e72-2bfd-4963-8c49-b3386347aaa3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:07 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:07 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:07 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:07 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:07 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:07 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: INFO os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c5:ab,bridge_name='br-int',has_traffic_filtering=True,id=f984771f-43c1-4565-8e7f-34d142b19801,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf984771f-43')
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ee43811-1303-4a84-8bd4-0de882daac34", "address": "fa:16:3e:37:23:e2", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee43811-13", "ovs_interfaceid": "6ee43811-1303-4a84-8bd4-0de882daac34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "6ee43811-1303-4a84-8bd4-0de882daac34", "address": "fa:16:3e:37:23:e2", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee43811-13", "ovs_interfaceid": "6ee43811-1303-4a84-8bd4-0de882daac34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ee43811-1303-4a84-8bd4-0de882daac34,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee43811-13') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ee43811-1303-4a84-8bd4-0de882daac34,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee43811-13') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ee43811-13, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ee43811-13, col_values=(('external_ids', {'iface-id': '6ee43811-1303-4a84-8bd4-0de882daac34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:23:e2', 'vm-uuid': '7133ac6b-6627-4aaa-86f9-9ac3c8f8139b'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcd6ba2-f0fa-4ea6-a41d-79d95f2e29db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260]
Apr 12 06:23:07 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260] successful.
Apr 12 06:23:07 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: INFO os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ee43811-1303-4a84-8bd4-0de882daac34,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee43811-13')
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "address": "fa:16:3e:e5:63:8c", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1585d729-d8", "ovs_interfaceid": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "address": "fa:16:3e:e5:63:8c", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1585d729-d8", "ovs_interfaceid": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:63:8c,bridge_name='br-int',has_traffic_filtering=True,id=1585d729-d8e7-44e3-b0d6-2367ec0fb1cb,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1585d729-d8') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:63:8c,bridge_name='br-int',has_traffic_filtering=True,id=1585d729-d8e7-44e3-b0d6-2367ec0fb1cb,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1585d729-d8') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[775b0779-d27e-435a-ab5c-a8d6b8e4a346]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1585d729-d8, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1585d729-d8, col_values=(('external_ids', {'iface-id': '1585d729-d8e7-44e3-b0d6-2367ec0fb1cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:63:8c', 'vm-uuid': '7133ac6b-6627-4aaa-86f9-9ac3c8f8139b'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6ee9dd-37d1-419a-90ad-3d09df61ccfc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:07 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:07 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:07 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:23:07 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:07 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:07 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:07 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:23:07 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:23:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7f4200-75c3-4b62-9c14-7b662a135008]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcOxDrPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:08 user nova-compute[71711]: INFO os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:63:8c,bridge_name='br-int',has_traffic_filtering=True,id=1585d729-d8e7-44e3-b0d6-2367ec0fb1cb,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1585d729-d8')
Apr 12 06:23:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "address": "fa:16:3e:0b:4f:d7", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b7b070-9e", "ovs_interfaceid": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "address": "fa:16:3e:0b:4f:d7", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b7b070-9e", "ovs_interfaceid": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=22b7b070-9ef1-402f-8cbc-50684b0dad1c,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b7b070-9e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=22b7b070-9ef1-402f-8cbc-50684b0dad1c,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b7b070-9e') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22b7b070-9e, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22b7b070-9e, col_values=(('external_ids', {'iface-id': '22b7b070-9ef1-402f-8cbc-50684b0dad1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:4f:d7', 'vm-uuid': '7133ac6b-6627-4aaa-86f9-9ac3c8f8139b'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:08 user nova-compute[71711]: INFO os_vif [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=22b7b070-9ef1-402f-8cbc-50684b0dad1c,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b7b070-9e')
Apr 12 06:23:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] No BDM found with device name hda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] No VIF found with MAC fa:16:3e:d3:88:42, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] No VIF found with MAC fa:16:3e:37:23:e2, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:23:08 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Using config drive
Apr 12 06:23:08 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Creating config drive at /opt/stack/data/nova/instances/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b/disk.config
Apr 12 06:23:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeutt9s27 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeutt9s27" returned: 0 in 0.054s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] <== connect_volume: return (2589ms) {'type': 'block', 'scsi_wwn': '26434393862343066', 'path': '/dev/sde'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434393862343066', 'path': '/dev/sde'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:23:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1182120878',display_name='tempest-TestShelveInstance-server-1182120878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1182120878',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/XYJS5WZMk53chHKmw/+iSEEOXZF7wP3pIbC0AGTht+XIXJedtGoPTQqkFu+XBL60BEsYozXDU+97steer9vl1moNpsewzRRDuc/MQvBwxKIIaehE8Onlx0BWl81dCFA==',key_name='tempest-TestShelveInstance-1634672150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7742afa38eb46818efaf3b811c417ba',ramdisk_id='',reservation_id='r-jkmurz28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-735091148',owner_user_name='tempest-TestShelveInstance-735091148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:23:02Z,user_data=None,user_id='9ed3a446901644b6a622afb3166f08dc',uuid=7141c80d-34a9-40cc-a792-b01ffd9155b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Converting VIF {"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG nova.objects.instance [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lazy-loading 'pci_devices' on Instance uuid 7141c80d-34a9-40cc-a792-b01ffd9155b6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:23:09 user nova-compute[71711]:   <uuid>7141c80d-34a9-40cc-a792-b01ffd9155b6</uuid>
Apr 12 06:23:09 user nova-compute[71711]:   <name>instance-0000000a</name>
Apr 12 06:23:09 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:23:09 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:23:09 user nova-compute[71711]:   <metadata>
Apr 12 06:23:09 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:23:09 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:23:09 user nova-compute[71711]:       <nova:name>tempest-TestShelveInstance-server-1182120878</nova:name>
Apr 12 06:23:09 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:23:06</nova:creationTime>
Apr 12 06:23:09 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:23:09 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:23:09 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:23:09 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:23:09 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:23:09 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:23:09 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:23:09 user nova-compute[71711]:       <nova:owner>
Apr 12 06:23:09 user nova-compute[71711]:         <nova:user uuid="9ed3a446901644b6a622afb3166f08dc">tempest-TestShelveInstance-735091148-project-member</nova:user>
Apr 12 06:23:09 user nova-compute[71711]:         <nova:project uuid="c7742afa38eb46818efaf3b811c417ba">tempest-TestShelveInstance-735091148</nova:project>
Apr 12 06:23:09 user nova-compute[71711]:       </nova:owner>
Apr 12 06:23:09 user nova-compute[71711]:       <nova:ports>
Apr 12 06:23:09 user nova-compute[71711]:         <nova:port uuid="f2b23249-b032-47f5-973e-922f210b40b2">
Apr 12 06:23:09 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 06:23:09 user nova-compute[71711]:         </nova:port>
Apr 12 06:23:09 user nova-compute[71711]:       </nova:ports>
Apr 12 06:23:09 user nova-compute[71711]:     </nova:instance>
Apr 12 06:23:09 user nova-compute[71711]:   </metadata>
Apr 12 06:23:09 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:23:09 user nova-compute[71711]:     <system>
Apr 12 06:23:09 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:23:09 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:23:09 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:23:09 user nova-compute[71711]:       <entry name="serial">7141c80d-34a9-40cc-a792-b01ffd9155b6</entry>
Apr 12 06:23:09 user nova-compute[71711]:       <entry name="uuid">7141c80d-34a9-40cc-a792-b01ffd9155b6</entry>
Apr 12 06:23:09 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:23:09 user nova-compute[71711]:     </system>
Apr 12 06:23:09 user nova-compute[71711]:   </sysinfo>
Apr 12 06:23:09 user nova-compute[71711]:   <os>
Apr 12 06:23:09 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:23:09 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:23:09 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:23:09 user nova-compute[71711]:   </os>
Apr 12 06:23:09 user nova-compute[71711]:   <features>
Apr 12 06:23:09 user nova-compute[71711]:     <acpi/>
Apr 12 06:23:09 user nova-compute[71711]:     <apic/>
Apr 12 06:23:09 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:23:09 user nova-compute[71711]:   </features>
Apr 12 06:23:09 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:23:09 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:23:09 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:23:09 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:23:09 user nova-compute[71711]:   </clock>
Apr 12 06:23:09 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:23:09 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:23:09 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:23:09 user nova-compute[71711]:   </cpu>
Apr 12 06:23:09 user nova-compute[71711]:   <devices>
Apr 12 06:23:09 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:23:09 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:23:09 user nova-compute[71711]:       <source dev="/dev/sde"/>
Apr 12 06:23:09 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:23:09 user nova-compute[71711]:       <serial>d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a</serial>
Apr 12 06:23:09 user nova-compute[71711]:     </disk>
Apr 12 06:23:09 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:23:09 user nova-compute[71711]:       <mac address="fa:16:3e:29:02:01"/>
Apr 12 06:23:09 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:23:09 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:23:09 user nova-compute[71711]:       <target dev="tapf2b23249-b0"/>
Apr 12 06:23:09 user nova-compute[71711]:     </interface>
Apr 12 06:23:09 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:23:09 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/7141c80d-34a9-40cc-a792-b01ffd9155b6/console.log" append="off"/>
Apr 12 06:23:09 user nova-compute[71711]:     </serial>
Apr 12 06:23:09 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:23:09 user nova-compute[71711]:     <video>
Apr 12 06:23:09 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:23:09 user nova-compute[71711]:     </video>
Apr 12 06:23:09 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:23:09 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:23:09 user nova-compute[71711]:     </rng>
Apr 12 06:23:09 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:23:09 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:23:09 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:23:09 user nova-compute[71711]:     </memballoon>
Apr 12 06:23:09 user nova-compute[71711]:   </devices>
Apr 12 06:23:09 user nova-compute[71711]: </domain>
Apr 12 06:23:09 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:23:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1182120878',display_name='tempest-TestShelveInstance-server-1182120878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1182120878',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/XYJS5WZMk53chHKmw/+iSEEOXZF7wP3pIbC0AGTht+XIXJedtGoPTQqkFu+XBL60BEsYozXDU+97steer9vl1moNpsewzRRDuc/MQvBwxKIIaehE8Onlx0BWl81dCFA==',key_name='tempest-TestShelveInstance-1634672150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7742afa38eb46818efaf3b811c417ba',ramdisk_id='',reservation_id='r-jkmurz28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-735091148',owner_user_name='tempest-TestShelveInstance-735091148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:23:02Z,user_data=None,user_id='9ed3a446901644b6a622afb3166f08dc',uuid=7141c80d-34a9-40cc-a792-b01ffd9155b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Converting VIF {"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG os_vif [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2b23249-b0, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2b23249-b0, col_values=(('external_ids', {'iface-id': 'f2b23249-b032-47f5-973e-922f210b40b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:02:01', 'vm-uuid': '7141c80d-34a9-40cc-a792-b01ffd9155b6'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:09 user nova-compute[71711]: INFO os_vif [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0')
Apr 12 06:23:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] No VIF found with MAC fa:16:3e:29:02:01, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:23:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-b3e9f301-6190-45d3-9508-73b735b98fc9 req-c65a2e34-122a-4672-ad2d-37b899c75160 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b3e9f301-6190-45d3-9508-73b735b98fc9 req-c65a2e34-122a-4672-ad2d-37b899c75160 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b3e9f301-6190-45d3-9508-73b735b98fc9 req-c65a2e34-122a-4672-ad2d-37b899c75160 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b3e9f301-6190-45d3-9508-73b735b98fc9 req-c65a2e34-122a-4672-ad2d-37b899c75160 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-b3e9f301-6190-45d3-9508-73b735b98fc9 req-c65a2e34-122a-4672-ad2d-37b899c75160 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:10 user nova-compute[71711]: WARNING nova.compute.manager [req-b3e9f301-6190-45d3-9508-73b735b98fc9 req-c65a2e34-122a-4672-ad2d-37b899c75160 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-55fc6a3a-a62f-406f-9583-f4168544b133 for instance with vm_state building and task_state spawning.
Apr 12 06:23:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-4740961e-fd1b-4956-bb8c-8ffed87c1bcd req-7809e985-253c-406e-ad84-6ad03a549dc3 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-48b06cf1-3d27-423d-a0fb-952c396a727c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4740961e-fd1b-4956-bb8c-8ffed87c1bcd req-7809e985-253c-406e-ad84-6ad03a549dc3 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4740961e-fd1b-4956-bb8c-8ffed87c1bcd req-7809e985-253c-406e-ad84-6ad03a549dc3 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4740961e-fd1b-4956-bb8c-8ffed87c1bcd req-7809e985-253c-406e-ad84-6ad03a549dc3 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-4740961e-fd1b-4956-bb8c-8ffed87c1bcd req-7809e985-253c-406e-ad84-6ad03a549dc3 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-48b06cf1-3d27-423d-a0fb-952c396a727c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:11 user nova-compute[71711]: WARNING nova.compute.manager [req-4740961e-fd1b-4956-bb8c-8ffed87c1bcd req-7809e985-253c-406e-ad84-6ad03a549dc3 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-48b06cf1-3d27-423d-a0fb-952c396a727c for instance with vm_state building and task_state spawning.
Apr 12 06:23:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-6232d287-b11f-4bb8-ae8e-ff43ae64b8b3 req-430976a5-0341-4c3d-b3a8-0398f06d597e service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6232d287-b11f-4bb8-ae8e-ff43ae64b8b3 req-430976a5-0341-4c3d-b3a8-0398f06d597e service nova] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6232d287-b11f-4bb8-ae8e-ff43ae64b8b3 req-430976a5-0341-4c3d-b3a8-0398f06d597e service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6232d287-b11f-4bb8-ae8e-ff43ae64b8b3 req-430976a5-0341-4c3d-b3a8-0398f06d597e service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-6232d287-b11f-4bb8-ae8e-ff43ae64b8b3 req-430976a5-0341-4c3d-b3a8-0398f06d597e service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] No waiting events found dispatching network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:11 user nova-compute[71711]: WARNING nova.compute.manager [req-6232d287-b11f-4bb8-ae8e-ff43ae64b8b3 req-430976a5-0341-4c3d-b3a8-0398f06d597e service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received unexpected event network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 for instance with vm_state building and task_state spawning.
Apr 12 06:23:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-a88d6ce2-c4e7-4fb0-9aaf-5f23a9293ed6 req-f4454a29-2c96-47b6-8d52-47cb58618d74 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a88d6ce2-c4e7-4fb0-9aaf-5f23a9293ed6 req-f4454a29-2c96-47b6-8d52-47cb58618d74 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a88d6ce2-c4e7-4fb0-9aaf-5f23a9293ed6 req-f4454a29-2c96-47b6-8d52-47cb58618d74 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a88d6ce2-c4e7-4fb0-9aaf-5f23a9293ed6 req-f4454a29-2c96-47b6-8d52-47cb58618d74 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-a88d6ce2-c4e7-4fb0-9aaf-5f23a9293ed6 req-f4454a29-2c96-47b6-8d52-47cb58618d74 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:12 user nova-compute[71711]: WARNING nova.compute.manager [req-a88d6ce2-c4e7-4fb0-9aaf-5f23a9293ed6 req-f4454a29-2c96-47b6-8d52-47cb58618d74 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-55fc6a3a-a62f-406f-9583-f4168544b133 for instance with vm_state building and task_state spawning.
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-48b06cf1-3d27-423d-a0fb-952c396a727c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-48b06cf1-3d27-423d-a0fb-952c396a727c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:13 user nova-compute[71711]: WARNING nova.compute.manager [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-48b06cf1-3d27-423d-a0fb-952c396a727c for instance with vm_state building and task_state spawning.
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-1684f1e7-b9c2-4228-8809-ebaae1ed41c7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-1684f1e7-b9c2-4228-8809-ebaae1ed41c7 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:13 user nova-compute[71711]: WARNING nova.compute.manager [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-1684f1e7-b9c2-4228-8809-ebaae1ed41c7 for instance with vm_state building and task_state spawning.
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-1684f1e7-b9c2-4228-8809-ebaae1ed41c7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-1684f1e7-b9c2-4228-8809-ebaae1ed41c7 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:13 user nova-compute[71711]: WARNING nova.compute.manager [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-1684f1e7-b9c2-4228-8809-ebaae1ed41c7 for instance with vm_state building and task_state spawning.
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:13 user nova-compute[71711]: WARNING nova.compute.manager [req-e15c4471-565a-4f12-82f9-8395255b0da9 req-8633c836-c9a7-49bf-85b9-9b086130195a service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb for instance with vm_state building and task_state spawning.
Apr 12 06:23:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] No waiting events found dispatching network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:13 user nova-compute[71711]: WARNING nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received unexpected event network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 for instance with vm_state building and task_state spawning.
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-f984771f-43c1-4565-8e7f-34d142b19801 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-f984771f-43c1-4565-8e7f-34d142b19801 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:13 user nova-compute[71711]: WARNING nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-f984771f-43c1-4565-8e7f-34d142b19801 for instance with vm_state building and task_state spawning.
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-f984771f-43c1-4565-8e7f-34d142b19801 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-f984771f-43c1-4565-8e7f-34d142b19801 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:13 user nova-compute[71711]: WARNING nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-f984771f-43c1-4565-8e7f-34d142b19801 for instance with vm_state building and task_state spawning.
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-6ee43811-1303-4a84-8bd4-0de882daac34 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-6ee43811-1303-4a84-8bd4-0de882daac34 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:13 user nova-compute[71711]: WARNING nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-6ee43811-1303-4a84-8bd4-0de882daac34 for instance with vm_state building and task_state spawning.
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-6ee43811-1303-4a84-8bd4-0de882daac34 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-6ee43811-1303-4a84-8bd4-0de882daac34 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:13 user nova-compute[71711]: WARNING nova.compute.manager [req-bf4450a9-d117-46f9-b169-91661c6121ad req-bd7ef566-0561-4bfd-8177-600c37179572 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-6ee43811-1303-4a84-8bd4-0de882daac34 for instance with vm_state building and task_state spawning.
Apr 12 06:23:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280594.730983, 7141c80d-34a9-40cc-a792-b01ffd9155b6 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:23:14 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] VM Resumed (Lifecycle Event)
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:23:14 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Instance spawned successfully.
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:14 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280594.7340248, 7141c80d-34a9-40cc-a792-b01ffd9155b6 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:23:14 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] VM Started (Lifecycle Event)
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:23:14 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:23:14 user nova-compute[71711]: INFO nova.compute.manager [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Took 8.48 seconds to spawn the instance on the hypervisor.
Apr 12 06:23:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:23:14 user nova-compute[71711]: INFO nova.compute.manager [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Took 14.00 seconds to build instance.
Apr 12 06:23:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0fad0d74-a7fe-4f36-a7b4-aa627bb6d33d tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.091s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:15 user nova-compute[71711]: WARNING nova.compute.manager [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb for instance with vm_state building and task_state spawning.
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-22b7b070-9ef1-402f-8cbc-50684b0dad1c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-22b7b070-9ef1-402f-8cbc-50684b0dad1c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:15 user nova-compute[71711]: WARNING nova.compute.manager [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-22b7b070-9ef1-402f-8cbc-50684b0dad1c for instance with vm_state building and task_state spawning.
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-22b7b070-9ef1-402f-8cbc-50684b0dad1c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-22b7b070-9ef1-402f-8cbc-50684b0dad1c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:15 user nova-compute[71711]: WARNING nova.compute.manager [req-c7cd8a10-000b-4985-9176-ada5147add4e req-ec688ae5-a1ac-44cb-b1a1-877019d8b403 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-22b7b070-9ef1-402f-8cbc-50684b0dad1c for instance with vm_state building and task_state spawning.
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280595.5445411, 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:23:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] VM Resumed (Lifecycle Event)
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:23:15 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Instance spawned successfully.
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:23:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280595.5489755, 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:23:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] VM Started (Lifecycle Event)
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:23:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:23:15 user nova-compute[71711]: INFO nova.compute.manager [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Took 12.18 seconds to spawn the instance on the hypervisor.
Apr 12 06:23:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:23:15 user nova-compute[71711]: INFO nova.compute.manager [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Took 31.04 seconds to build instance.
Apr 12 06:23:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b74fafe7-9054-4bb7-9251-513929a7f4a1 tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.136s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "2a24ff32-6994-4754-be34-7664bbe21d16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "2a24ff32-6994-4754-be34-7664bbe21d16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:28 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:23:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:23:28 user nova-compute[71711]: INFO nova.compute.claims [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Claim successful on node user
Apr 12 06:23:28 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:23:28 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:23:29 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:23:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG nova.policy [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e761442395d14d7f82216e3d4174e43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbca90b5b5fb49ca857aa4e215a99e37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:23:29 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Creating image(s)
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "/opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "/opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk 1073741824" returned: 0 in 0.052s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Successfully created port: de80dcd5-e1e5-485d-ab7f-e595447273da {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Cannot resize image /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lazy-loading 'migration_context' on Instance uuid 2a24ff32-6994-4754-be34-7664bbe21d16 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Ensure instance console log exists: /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Successfully updated port: de80dcd5-e1e5-485d-ab7f-e595447273da {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "refresh_cache-2a24ff32-6994-4754-be34-7664bbe21d16" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquired lock "refresh_cache-2a24ff32-6994-4754-be34-7664bbe21d16" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.compute.manager [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Received event network-changed-de80dcd5-e1e5-485d-ab7f-e595447273da {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.compute.manager [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Refreshing instance network info cache due to event network-changed-de80dcd5-e1e5-485d-ab7f-e595447273da. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] Acquiring lock "refresh_cache-2a24ff32-6994-4754-be34-7664bbe21d16" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Updating instance_info_cache with network_info: [{"id": "de80dcd5-e1e5-485d-ab7f-e595447273da", "address": "fa:16:3e:a7:22:e3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde80dcd5-e1", "ovs_interfaceid": "de80dcd5-e1e5-485d-ab7f-e595447273da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Releasing lock "refresh_cache-2a24ff32-6994-4754-be34-7664bbe21d16" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Instance network_info: |[{"id": "de80dcd5-e1e5-485d-ab7f-e595447273da", "address": "fa:16:3e:a7:22:e3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde80dcd5-e1", "ovs_interfaceid": "de80dcd5-e1e5-485d-ab7f-e595447273da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] Acquired lock "refresh_cache-2a24ff32-6994-4754-be34-7664bbe21d16" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.network.neutron [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Refreshing network info cache for port de80dcd5-e1e5-485d-ab7f-e595447273da {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Start _get_guest_xml network_info=[{"id": "de80dcd5-e1e5-485d-ab7f-e595447273da", "address": "fa:16:3e:a7:22:e3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde80dcd5-e1", "ovs_interfaceid": "de80dcd5-e1e5-485d-ab7f-e595447273da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:23:30 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:23:30 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-696456814',display_name='tempest-ServersNegativeTestJSON-server-696456814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-696456814',id=11,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbca90b5b5fb49ca857aa4e215a99e37',ramdisk_id='',reservation_id='r-36cwghu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-815999574',owner_user_name='tempest-ServersNegativeTestJSON-815999574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:23:29Z,user_data=None,user_id='e761442395d14d7f82216e3d4174e43a',uuid=2a24ff32-6994-4754-be34-7664bbe21d16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de80dcd5-e1e5-485d-ab7f-e595447273da", "address": "fa:16:3e:a7:22:e3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde80dcd5-e1", "ovs_interfaceid": "de80dcd5-e1e5-485d-ab7f-e595447273da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Converting VIF {"id": "de80dcd5-e1e5-485d-ab7f-e595447273da", "address": "fa:16:3e:a7:22:e3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde80dcd5-e1", "ovs_interfaceid": "de80dcd5-e1e5-485d-ab7f-e595447273da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=de80dcd5-e1e5-485d-ab7f-e595447273da,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde80dcd5-e1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:30 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a24ff32-6994-4754-be34-7664bbe21d16 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:23:31 user nova-compute[71711]:   <uuid>2a24ff32-6994-4754-be34-7664bbe21d16</uuid>
Apr 12 06:23:31 user nova-compute[71711]:   <name>instance-0000000b</name>
Apr 12 06:23:31 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:23:31 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:23:31 user nova-compute[71711]:   <metadata>
Apr 12 06:23:31 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:23:31 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:23:31 user nova-compute[71711]:       <nova:name>tempest-ServersNegativeTestJSON-server-696456814</nova:name>
Apr 12 06:23:31 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:23:30</nova:creationTime>
Apr 12 06:23:31 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:23:31 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:23:31 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:23:31 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:23:31 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:23:31 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:23:31 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:23:31 user nova-compute[71711]:       <nova:owner>
Apr 12 06:23:31 user nova-compute[71711]:         <nova:user uuid="e761442395d14d7f82216e3d4174e43a">tempest-ServersNegativeTestJSON-815999574-project-member</nova:user>
Apr 12 06:23:31 user nova-compute[71711]:         <nova:project uuid="fbca90b5b5fb49ca857aa4e215a99e37">tempest-ServersNegativeTestJSON-815999574</nova:project>
Apr 12 06:23:31 user nova-compute[71711]:       </nova:owner>
Apr 12 06:23:31 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:23:31 user nova-compute[71711]:       <nova:ports>
Apr 12 06:23:31 user nova-compute[71711]:         <nova:port uuid="de80dcd5-e1e5-485d-ab7f-e595447273da">
Apr 12 06:23:31 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 06:23:31 user nova-compute[71711]:         </nova:port>
Apr 12 06:23:31 user nova-compute[71711]:       </nova:ports>
Apr 12 06:23:31 user nova-compute[71711]:     </nova:instance>
Apr 12 06:23:31 user nova-compute[71711]:   </metadata>
Apr 12 06:23:31 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:23:31 user nova-compute[71711]:     <system>
Apr 12 06:23:31 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:23:31 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:23:31 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:23:31 user nova-compute[71711]:       <entry name="serial">2a24ff32-6994-4754-be34-7664bbe21d16</entry>
Apr 12 06:23:31 user nova-compute[71711]:       <entry name="uuid">2a24ff32-6994-4754-be34-7664bbe21d16</entry>
Apr 12 06:23:31 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:23:31 user nova-compute[71711]:     </system>
Apr 12 06:23:31 user nova-compute[71711]:   </sysinfo>
Apr 12 06:23:31 user nova-compute[71711]:   <os>
Apr 12 06:23:31 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:23:31 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:23:31 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:23:31 user nova-compute[71711]:   </os>
Apr 12 06:23:31 user nova-compute[71711]:   <features>
Apr 12 06:23:31 user nova-compute[71711]:     <acpi/>
Apr 12 06:23:31 user nova-compute[71711]:     <apic/>
Apr 12 06:23:31 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:23:31 user nova-compute[71711]:   </features>
Apr 12 06:23:31 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:23:31 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:23:31 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:23:31 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:23:31 user nova-compute[71711]:   </clock>
Apr 12 06:23:31 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:23:31 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:23:31 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:23:31 user nova-compute[71711]:   </cpu>
Apr 12 06:23:31 user nova-compute[71711]:   <devices>
Apr 12 06:23:31 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:23:31 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:23:31 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk"/>
Apr 12 06:23:31 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:23:31 user nova-compute[71711]:     </disk>
Apr 12 06:23:31 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:23:31 user nova-compute[71711]:       <mac address="fa:16:3e:a7:22:e3"/>
Apr 12 06:23:31 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:23:31 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:23:31 user nova-compute[71711]:       <target dev="tapde80dcd5-e1"/>
Apr 12 06:23:31 user nova-compute[71711]:     </interface>
Apr 12 06:23:31 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:23:31 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/console.log" append="off"/>
Apr 12 06:23:31 user nova-compute[71711]:     </serial>
Apr 12 06:23:31 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:23:31 user nova-compute[71711]:     <video>
Apr 12 06:23:31 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:23:31 user nova-compute[71711]:     </video>
Apr 12 06:23:31 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:23:31 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:23:31 user nova-compute[71711]:     </rng>
Apr 12 06:23:31 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:23:31 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:23:31 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:23:31 user nova-compute[71711]:     </memballoon>
Apr 12 06:23:31 user nova-compute[71711]:   </devices>
Apr 12 06:23:31 user nova-compute[71711]: </domain>
Apr 12 06:23:31 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-696456814',display_name='tempest-ServersNegativeTestJSON-server-696456814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-696456814',id=11,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbca90b5b5fb49ca857aa4e215a99e37',ramdisk_id='',reservation_id='r-36cwghu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-815999574',owner_user_name='tempest-ServersNegativeTestJSON-815999574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:23:29Z,user_data=None,user_id='e761442395d14d7f82216e3d4174e43a',uuid=2a24ff32-6994-4754-be34-7664bbe21d16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de80dcd5-e1e5-485d-ab7f-e595447273da", "address": "fa:16:3e:a7:22:e3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde80dcd5-e1", "ovs_interfaceid": "de80dcd5-e1e5-485d-ab7f-e595447273da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Converting VIF {"id": "de80dcd5-e1e5-485d-ab7f-e595447273da", "address": "fa:16:3e:a7:22:e3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde80dcd5-e1", "ovs_interfaceid": "de80dcd5-e1e5-485d-ab7f-e595447273da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=de80dcd5-e1e5-485d-ab7f-e595447273da,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde80dcd5-e1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG os_vif [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=de80dcd5-e1e5-485d-ab7f-e595447273da,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde80dcd5-e1') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde80dcd5-e1, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde80dcd5-e1, col_values=(('external_ids', {'iface-id': 'de80dcd5-e1e5-485d-ab7f-e595447273da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:22:e3', 'vm-uuid': '2a24ff32-6994-4754-be34-7664bbe21d16'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:31 user nova-compute[71711]: INFO os_vif [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=de80dcd5-e1e5-485d-ab7f-e595447273da,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde80dcd5-e1')
Apr 12 06:23:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] No VIF found with MAC fa:16:3e:a7:22:e3, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG nova.network.neutron [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Updated VIF entry in instance network info cache for port de80dcd5-e1e5-485d-ab7f-e595447273da. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG nova.network.neutron [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Updating instance_info_cache with network_info: [{"id": "de80dcd5-e1e5-485d-ab7f-e595447273da", "address": "fa:16:3e:a7:22:e3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde80dcd5-e1", "ovs_interfaceid": "de80dcd5-e1e5-485d-ab7f-e595447273da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a7414fc5-594a-4dd4-a52d-b8a17d75387a req-beb1fd07-030b-4de9-b72e-cd50db0cf318 service nova] Releasing lock "refresh_cache-2a24ff32-6994-4754-be34-7664bbe21d16" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:23:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:32 user nova-compute[71711]: DEBUG nova.compute.manager [req-16e44930-0f62-4a76-9ef9-dfa12b0090d7 req-599fecf5-b90e-40b8-9788-afda42db733c service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Received event network-vif-plugged-de80dcd5-e1e5-485d-ab7f-e595447273da {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-16e44930-0f62-4a76-9ef9-dfa12b0090d7 req-599fecf5-b90e-40b8-9788-afda42db733c service nova] Acquiring lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-16e44930-0f62-4a76-9ef9-dfa12b0090d7 req-599fecf5-b90e-40b8-9788-afda42db733c service nova] Lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-16e44930-0f62-4a76-9ef9-dfa12b0090d7 req-599fecf5-b90e-40b8-9788-afda42db733c service nova] Lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:32 user nova-compute[71711]: DEBUG nova.compute.manager [req-16e44930-0f62-4a76-9ef9-dfa12b0090d7 req-599fecf5-b90e-40b8-9788-afda42db733c service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] No waiting events found dispatching network-vif-plugged-de80dcd5-e1e5-485d-ab7f-e595447273da {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:32 user nova-compute[71711]: WARNING nova.compute.manager [req-16e44930-0f62-4a76-9ef9-dfa12b0090d7 req-599fecf5-b90e-40b8-9788-afda42db733c service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Received unexpected event network-vif-plugged-de80dcd5-e1e5-485d-ab7f-e595447273da for instance with vm_state building and task_state spawning.
Apr 12 06:23:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280614.705583, 2a24ff32-6994-4754-be34-7664bbe21d16 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:23:34 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] VM Resumed (Lifecycle Event)
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:23:34 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Instance spawned successfully.
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:23:34 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280614.7070422, 2a24ff32-6994-4754-be34-7664bbe21d16 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:23:34 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] VM Started (Lifecycle Event)
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:23:34 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:23:34 user nova-compute[71711]: INFO nova.compute.manager [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Took 5.57 seconds to spawn the instance on the hypervisor.
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-47cd7419-e7ec-4901-84db-10171a828566 req-e994a05a-3c75-40a5-bcdc-8f41ce2b83e4 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Received event network-vif-plugged-de80dcd5-e1e5-485d-ab7f-e595447273da {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-47cd7419-e7ec-4901-84db-10171a828566 req-e994a05a-3c75-40a5-bcdc-8f41ce2b83e4 service nova] Acquiring lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-47cd7419-e7ec-4901-84db-10171a828566 req-e994a05a-3c75-40a5-bcdc-8f41ce2b83e4 service nova] Lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-47cd7419-e7ec-4901-84db-10171a828566 req-e994a05a-3c75-40a5-bcdc-8f41ce2b83e4 service nova] Lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-47cd7419-e7ec-4901-84db-10171a828566 req-e994a05a-3c75-40a5-bcdc-8f41ce2b83e4 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] No waiting events found dispatching network-vif-plugged-de80dcd5-e1e5-485d-ab7f-e595447273da {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:34 user nova-compute[71711]: WARNING nova.compute.manager [req-47cd7419-e7ec-4901-84db-10171a828566 req-e994a05a-3c75-40a5-bcdc-8f41ce2b83e4 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Received unexpected event network-vif-plugged-de80dcd5-e1e5-485d-ab7f-e595447273da for instance with vm_state building and task_state spawning.
Apr 12 06:23:34 user nova-compute[71711]: INFO nova.compute.manager [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Took 6.37 seconds to build instance.
Apr 12 06:23:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e201bbe3-8feb-4403-80ea-bf0595cc4499 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "2a24ff32-6994-4754-be34-7664bbe21d16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.470s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-changed-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Refreshing instance network info cache due to event network-changed-1e69d862-c01c-48c7-8795-00233f9e7812. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:23:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] Acquiring lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:23:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] Acquired lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:23:39 user nova-compute[71711]: DEBUG nova.network.neutron [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Refreshing network info cache for port 1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG nova.network.neutron [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updated VIF entry in instance network info cache for port 1e69d862-c01c-48c7-8795-00233f9e7812. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG nova.network.neutron [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updating instance_info_cache with network_info: [{"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-33cbf061-b289-4727-aa12-19112b70e4e8 req-0ed79245-918e-40b1-85b9-b97fe79f4f46 service nova] Releasing lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "149703ba-0e5a-46f3-b988-d864de1c2137" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "149703ba-0e5a-46f3-b988-d864de1c2137" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lazy-loading 'flavor' on Instance uuid 149703ba-0e5a-46f3-b988-d864de1c2137 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "149703ba-0e5a-46f3-b988-d864de1c2137" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "149703ba-0e5a-46f3-b988-d864de1c2137" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "149703ba-0e5a-46f3-b988-d864de1c2137" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:40 user nova-compute[71711]: INFO nova.compute.manager [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Attaching volume fc6abfcd-2056-4ae6-a4d3-a20b324333a0 to /dev/vdb
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG os_brick.utils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fb102f-ecad-40aa-a1a4-6f0aa5158e94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0044e0-d358-4e57-9c53-a1b89cc69bfb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecd5014-f11a-402b-8c64-aecdb7588076]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f60e85-4c09-4a51-9347-f62bce7fab80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:23:41 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[991e7671-dd7c-4df1-aca0-8528c6525478]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG os_brick.utils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Updating existing volume attachment record: 6855b323-c038-4f0e-bc5f-103929619271 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updating instance_info_cache with network_info: [{"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG nova.objects.instance [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'flavor' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:41 user nova-compute[71711]: INFO nova.compute.manager [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Attaching volume 34023a39-bbf4-4afb-948b-0bff9f563bb8 to /dev/vdb
Apr 12 06:23:41 user nova-compute[71711]: DEBUG os_brick.utils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:23:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9443a1c-c374-4fa5-a7f3-841944ed0037]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb0abef-521f-45eb-8b7c-187644e79d90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b2961e-67e0-4c54-b2da-11449a2461cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bf176c-6c97-451b-b1cf-67a9f41992b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:23:42 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d98ae84-23d1-40bf-8d78-655e35f85d70]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG os_brick.utils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updating existing volume attachment record: 89896312-6c7c-4a65-a4f5-fd99ee079f77 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-changed-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Refreshing instance network info cache due to event network-changed-8fba3fe8-62b6-46be-a025-3ec5a629ee80. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] Acquiring lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] Acquired lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG nova.network.neutron [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Refreshing network info cache for port 8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUPcrIFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:23:46 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:23:46 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:23:46 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:23:46 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:23:46 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7578MB free_disk=26.48456573486328GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[60310b82-8714-41f4-a742-117d6143eb26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:23:46 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[522ebbb1-5273-4180-a510-67fe7a108b21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0] added
Apr 12 06:23:46 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.network.neutron [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updated VIF entry in instance network info cache for port 8fba3fe8-62b6-46be-a025-3ec5a629ee80. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.network.neutron [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating instance_info_cache with network_info: [{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0aeb4a-db48-4e98-8304-3aa560c698de]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7b1e79a9-f799-4691-8106-8a623cf3067b req-be6991b4-723f-4e19-8b53-372e73f9537c service nova] Releasing lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dca9cad-baa2-4d48-bb0d-86b90dab5d5e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUPcrIFu {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUPcrIFu" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa2539d-476a-4846-8107-a0d247df6b58]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mUPcrIFu'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e5eecc-cd5c-4c7c-b17e-5b2c4bec752c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7dee97a4-9497-43c2-a688-7bedd1441885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance a528e600-7358-4b92-9b71-12759f405b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance eb450dca-84ef-47c4-9038-9269a661bb12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 149703ba-0e5a-46f3-b988-d864de1c2137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 2a24ff32-6994-4754-be34-7664bbe21d16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 33458552-cb23-41c7-9cb7-ef13301468f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aed6b6b-d3be-44fe-87cf-70cac02a6dff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:23:46 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:23:46 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a6513b-9d58-43f6-9823-9955d1be0fc7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0, portal: 172.16.0.220,3260]
Apr 12 06:23:46 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0, portal: 172.16.0.220,3260] successful.
Apr 12 06:23:46 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c4d343-bde8-498f-9509-310d8b5dbc74]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b88654d-6b18-49d9-88d4-be45bb66cf47]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:23:46 user nova-compute[71711]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 (non-flash)
Apr 12 06:23:46 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[25782775-1cb4-4a9b-b0d6-570b6775228d]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUPcrIFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:23:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmJGqRkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:23:47 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23739666263393431', 'path': '/dev/sdf'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739666263393431', 'path': '/dev/sdf'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.448s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:23:47 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:23:47 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lazy-loading 'flavor' on Instance uuid 149703ba-0e5a-46f3-b988-d864de1c2137 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[94091e8f-19bc-4d48-bf30-1356f0472e4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:23:47 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:23:47 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:23:47 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:23:47 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:23:47 user nova-compute[71711]:   <serial>fc6abfcd-2056-4ae6-a4d3-a20b324333a0</serial>
Apr 12 06:23:47 user nova-compute[71711]: </disk>
Apr 12 06:23:47 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c6f691-a37e-46d9-a67f-380ee9364342]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8] added
Apr 12 06:23:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07044d6-bc51-4e2f-9747-ed73543bf4f3]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee310cc-384e-4602-b3bb-427bedb78f9e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmJGqRkQ {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmJGqRkQ" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d586b8-ea2b-48ee-b7eb-3bd92b7c3ecc]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vmJGqRkQ'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fef92d-fe82-4248-b531-ffb46935481a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[99910772-38f1-468d-8590-7dcede0566ce]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f11170-d65b-4e8d-b3e4-751cdaea74a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260]
Apr 12 06:23:47 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260] successful.
Apr 12 06:23:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c22e6d-f2cb-4d42-aa1c-27a55bddf1f0]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3a5913-c4c6-42a1-9d03-0aba2f8a7874]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:23:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f2a8ce-2340-41fb-ba6b-57db023a2afc]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:23:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmJGqRkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] No VIF found with MAC fa:16:3e:7a:d2:3c, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a78ac28b-58e3-4d00-a164-a0729b14f7e0 tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "149703ba-0e5a-46f3-b988-d864de1c2137" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.478s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "149703ba-0e5a-46f3-b988-d864de1c2137" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "149703ba-0e5a-46f3-b988-d864de1c2137" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:48 user nova-compute[71711]: INFO nova.compute.manager [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Terminating instance
Apr 12 06:23:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] <== connect_volume: return (1830ms) {'type': 'block', 'scsi_wwn': '26233643335623338', 'path': '/dev/sdg'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233643335623338', 'path': '/dev/sdg'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG nova.objects.instance [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'flavor' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:23:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:23:48 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:23:48 user nova-compute[71711]:   <source dev="/dev/sdg"/>
Apr 12 06:23:48 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:23:48 user nova-compute[71711]:   <serial>34023a39-bbf4-4afb-948b-0bff9f563bb8</serial>
Apr 12 06:23:48 user nova-compute[71711]: </disk>
Apr 12 06:23:48 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-eb307030-d44f-4c64-b7f5-15962797b896 req-b04f3b38-f5ed-4d8c-b4d5-794513d3a6b7 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Received event network-vif-unplugged-9c356d39-d585-49ef-82de-d123a1d5e0d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-eb307030-d44f-4c64-b7f5-15962797b896 req-b04f3b38-f5ed-4d8c-b4d5-794513d3a6b7 service nova] Acquiring lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-eb307030-d44f-4c64-b7f5-15962797b896 req-b04f3b38-f5ed-4d8c-b4d5-794513d3a6b7 service nova] Lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-eb307030-d44f-4c64-b7f5-15962797b896 req-b04f3b38-f5ed-4d8c-b4d5-794513d3a6b7 service nova] Lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-eb307030-d44f-4c64-b7f5-15962797b896 req-b04f3b38-f5ed-4d8c-b4d5-794513d3a6b7 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] No waiting events found dispatching network-vif-unplugged-9c356d39-d585-49ef-82de-d123a1d5e0d6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-eb307030-d44f-4c64-b7f5-15962797b896 req-b04f3b38-f5ed-4d8c-b4d5-794513d3a6b7 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Received event network-vif-unplugged-9c356d39-d585-49ef-82de-d123a1d5e0d6 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No VIF found with MAC fa:16:3e:4c:89:31, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-38432502-1e7d-4807-866d-b82956d29761 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.710s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:49 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Instance destroyed successfully.
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.objects.instance [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lazy-loading 'resources' on Instance uuid 149703ba-0e5a-46f3-b988-d864de1c2137 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-61268901',display_name='tempest-DeleteServersTestJSON-server-61268901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-61268901',id=3,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e474b11e55eb45ff91f140aae7e2981d',ramdisk_id='',reservation_id='r-aogdq0lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1256853091',owner_user_name='tempest-DeleteServersTestJSON-1256853091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:22:02Z,user_data=None,user_id='ee2e2b19e9dd4d578a38e1ddec680b5d',uuid=149703ba-0e5a-46f3-b988-d864de1c2137,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "address": "fa:16:3e:7a:d2:3c", "network": {"id": "4f730b67-77d8-4694-9f2d-9c91555a540e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1684522379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e474b11e55eb45ff91f140aae7e2981d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c356d39-d5", "ovs_interfaceid": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Converting VIF {"id": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "address": "fa:16:3e:7a:d2:3c", "network": {"id": "4f730b67-77d8-4694-9f2d-9c91555a540e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1684522379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e474b11e55eb45ff91f140aae7e2981d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c356d39-d5", "ovs_interfaceid": "9c356d39-d585-49ef-82de-d123a1d5e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:d2:3c,bridge_name='br-int',has_traffic_filtering=True,id=9c356d39-d585-49ef-82de-d123a1d5e0d6,network=Network(4f730b67-77d8-4694-9f2d-9c91555a540e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c356d39-d5') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_vif [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:d2:3c,bridge_name='br-int',has_traffic_filtering=True,id=9c356d39-d585-49ef-82de-d123a1d5e0d6,network=Network(4f730b67-77d8-4694-9f2d-9c91555a540e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c356d39-d5') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c356d39-d5, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:23:49 user nova-compute[71711]: INFO os_vif [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:d2:3c,bridge_name='br-int',has_traffic_filtering=True,id=9c356d39-d585-49ef-82de-d123a1d5e0d6,network=Network(4f730b67-77d8-4694-9f2d-9c91555a540e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c356d39-d5')
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUPcrIFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:23:49 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[faecc034-cc03-430b-b55a-feee7df77751]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:23:49 user nova-compute[71711]: No targets found.
Apr 12 06:23:49 user nova-compute[71711]: iSNS:
Apr 12 06:23:49 user nova-compute[71711]: No targets found.
Apr 12 06:23:49 user nova-compute[71711]: STATIC:
Apr 12 06:23:49 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:23:49 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:23:49 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:23:49 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3
Apr 12 06:23:49 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:23:49 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:23:49 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:23:49 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:23:49 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:23:49 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29
Apr 12 06:23:49 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:23:49 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:23:49 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0
Apr 12 06:23:49 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:23:49 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:23:49 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6
Apr 12 06:23:49 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:23:49 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:23:49 user nova-compute[71711]: FIRMWARE:
Apr 12 06:23:49 user nova-compute[71711]: No targets found.
Apr 12 06:23:49 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:23:49 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:23:49 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0daa2a2-f4b3-4b52-9af7-ea256dd53d71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fa58c7-a316-4e6b-b37c-26efbf5d7bf1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:49 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:49 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:49 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:23:49 user nova-compute[71711]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 (non-flash)
Apr 12 06:23:49 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:23:49 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:23:49 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:23:49 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:23:49 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:23:49 user nova-compute[71711]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 (non-flash)
Apr 12 06:23:49 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:23:49 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c205120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0'): ({'sdf'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Removing single pathed devices sdf {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5c2e2d-7ae1-47b0-9bf8-17c7b0dae702]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[841c29dc-6ca0-42f6-91ff-b353c9302c50]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Flushing IO for device /dev/sdf {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29f8e49-c05e-486d-bdb0-c77dc4e9c88a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4b54bdfd-0105-47b9-8a43-0d67492fa57d tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4b54bdfd-0105-47b9-8a43-0d67492fa57d tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4b54bdfd-0105-47b9-8a43-0d67492fa57d tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4b54bdfd-0105-47b9-8a43-0d67492fa57d tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71711) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG nova.objects.instance [None req-4b54bdfd-0105-47b9-8a43-0d67492fa57d tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'flavor' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e30e3c1-1074-4091-a73f-adec327c2914]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[71428001-ba89-46ed-8821-4dd1a0ceeead]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf4528b-741b-4d9c-b194-dff02cfdc308]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0, portal: 172.16.0.220,3260]
Apr 12 06:23:50 user nova-compute[71711]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0, portal: 172.16.0.220,3260] successful.
Apr 12 06:23:50 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc6abfcd-2056-4ae6-a4d3-a20b324333a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a22cb4a-aee7-43ad-8af3-fb2f62b284c8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] <== disconnect_volume: return (382ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:23:50 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Deleting instance files /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137_del
Apr 12 06:23:50 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Deletion of /opt/stack/data/nova/instances/149703ba-0e5a-46f3-b988-d864de1c2137_del complete
Apr 12 06:23:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71711) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 12 06:23:50 user nova-compute[71711]: INFO nova.virt.libvirt.host [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] UEFI support detected
Apr 12 06:23:50 user nova-compute[71711]: INFO nova.compute.manager [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Took 1.47 seconds to destroy the instance on the hypervisor.
Apr 12 06:23:50 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG nova.compute.manager [req-d9c0c6a0-f50f-4b87-87f7-edac78163bef req-526ad8f6-c179-49e1-b6e1-08ae342a4615 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-unplugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d9c0c6a0-f50f-4b87-87f7-edac78163bef req-526ad8f6-c179-49e1-b6e1-08ae342a4615 service nova] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d9c0c6a0-f50f-4b87-87f7-edac78163bef req-526ad8f6-c179-49e1-b6e1-08ae342a4615 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d9c0c6a0-f50f-4b87-87f7-edac78163bef req-526ad8f6-c179-49e1-b6e1-08ae342a4615 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG nova.compute.manager [req-d9c0c6a0-f50f-4b87-87f7-edac78163bef req-526ad8f6-c179-49e1-b6e1-08ae342a4615 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] No waiting events found dispatching network-vif-unplugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:50 user nova-compute[71711]: WARNING nova.compute.manager [req-d9c0c6a0-f50f-4b87-87f7-edac78163bef req-526ad8f6-c179-49e1-b6e1-08ae342a4615 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received unexpected event network-vif-unplugged-1e69d862-c01c-48c7-8795-00233f9e7812 for instance with vm_state active and task_state powering-off.
Apr 12 06:23:50 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Instance destroyed successfully.
Apr 12 06:23:50 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4b54bdfd-0105-47b9-8a43-0d67492fa57d tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:23:50 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:23:50 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Took 0.60 seconds to deallocate network for instance.
Apr 12 06:23:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4b54bdfd-0105-47b9-8a43-0d67492fa57d tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.943s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:51 user nova-compute[71711]: DEBUG nova.compute.manager [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Received event network-vif-plugged-9c356d39-d585-49ef-82de-d123a1d5e0d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] Acquiring lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] Lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] Lock "149703ba-0e5a-46f3-b988-d864de1c2137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:51 user nova-compute[71711]: DEBUG nova.compute.manager [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] No waiting events found dispatching network-vif-plugged-9c356d39-d585-49ef-82de-d123a1d5e0d6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:51 user nova-compute[71711]: WARNING nova.compute.manager [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Received unexpected event network-vif-plugged-9c356d39-d585-49ef-82de-d123a1d5e0d6 for instance with vm_state active and task_state deleting.
Apr 12 06:23:51 user nova-compute[71711]: DEBUG nova.compute.manager [req-6b53bf18-9a84-4245-bdf5-68d378ef610f req-62fadbfa-1d33-48ae-90fc-1a407445b989 service nova] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Received event network-vif-deleted-9c356d39-d585-49ef-82de-d123a1d5e0d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:51 user nova-compute[71711]: INFO nova.compute.manager [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Took 0.87 seconds to detach 1 volumes for instance.
Apr 12 06:23:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:52 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:23:52 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:23:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:52 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Deleted allocations for instance 149703ba-0e5a-46f3-b988-d864de1c2137
Apr 12 06:23:52 user nova-compute[71711]: DEBUG nova.compute.manager [req-fc00653e-b6c3-4bff-8740-374de500a474 req-35af2c57-85af-4fb5-a9d3-dc264e8f2cb9 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:23:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fc00653e-b6c3-4bff-8740-374de500a474 req-35af2c57-85af-4fb5-a9d3-dc264e8f2cb9 service nova] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:23:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fc00653e-b6c3-4bff-8740-374de500a474 req-35af2c57-85af-4fb5-a9d3-dc264e8f2cb9 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:23:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fc00653e-b6c3-4bff-8740-374de500a474 req-35af2c57-85af-4fb5-a9d3-dc264e8f2cb9 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:52 user nova-compute[71711]: DEBUG nova.compute.manager [req-fc00653e-b6c3-4bff-8740-374de500a474 req-35af2c57-85af-4fb5-a9d3-dc264e8f2cb9 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] No waiting events found dispatching network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:23:52 user nova-compute[71711]: WARNING nova.compute.manager [req-fc00653e-b6c3-4bff-8740-374de500a474 req-35af2c57-85af-4fb5-a9d3-dc264e8f2cb9 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received unexpected event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 for instance with vm_state stopped and task_state None.
Apr 12 06:23:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-98a0af24-2e9b-4f40-a718-960bd610795c tempest-DeleteServersTestJSON-1256853091 tempest-DeleteServersTestJSON-1256853091-project-member] Lock "149703ba-0e5a-46f3-b988-d864de1c2137" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.597s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:23:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:23:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG nova.compute.manager [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Received event network-changed-89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG nova.compute.manager [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Refreshing instance network info cache due to event network-changed-89d27424-e166-42ad-b7e2-1b1a3101f207. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] Acquiring lock "refresh_cache-eb450dca-84ef-47c4-9038-9269a661bb12" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] Acquired lock "refresh_cache-eb450dca-84ef-47c4-9038-9269a661bb12" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG nova.network.neutron [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Refreshing network info cache for port 89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG nova.compute.manager [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-changed-e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG nova.compute.manager [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Refreshing instance network info cache due to event network-changed-e215c62b-ca21-474c-bb78-e65c3d3a6d23. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] Acquiring lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] Acquired lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG nova.network.neutron [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Refreshing network info cache for port e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280629.6286385, 149703ba-0e5a-46f3-b988-d864de1c2137 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:24:04 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] VM Stopped (Lifecycle Event)
Apr 12 06:24:04 user nova-compute[71711]: DEBUG nova.compute.manager [None req-eeec6b0e-b358-4978-9ac5-e4ca921d9cc0 None None] [instance: 149703ba-0e5a-46f3-b988-d864de1c2137] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "interface-1c02afd2-428b-49c9-a5e9-016fdeab1046-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "interface-1c02afd2-428b-49c9-a5e9-016fdeab1046-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG nova.objects.instance [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lazy-loading 'flavor' on Instance uuid 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG nova.network.neutron [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Updated VIF entry in instance network info cache for port 89d27424-e166-42ad-b7e2-1b1a3101f207. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG nova.network.neutron [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Updating instance_info_cache with network_info: [{"id": "89d27424-e166-42ad-b7e2-1b1a3101f207", "address": "fa:16:3e:14:7c:2e", "network": {"id": "6e696563-b74d-4d06-adb9-004d4c9e108d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034374773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e95975f26a4677b628411ddb18c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d27424-e1", "ovs_interfaceid": "89d27424-e166-42ad-b7e2-1b1a3101f207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG nova.network.neutron [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Updated VIF entry in instance network info cache for port e215c62b-ca21-474c-bb78-e65c3d3a6d23. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG nova.network.neutron [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Updating instance_info_cache with network_info: [{"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-54f35a5c-5ea9-486f-9142-c859ff169232 req-ee9f8390-0b11-464c-9a83-9442379ef773 service nova] Releasing lock "refresh_cache-eb450dca-84ef-47c4-9038-9269a661bb12" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:24:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a534b372-3273-48b4-ae02-dec0a6a24ddf req-9badb9be-0393-4d8f-be92-3518b6ce51f8 service nova] Releasing lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:24:05 user nova-compute[71711]: DEBUG nova.objects.instance [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lazy-loading 'pci_requests' on Instance uuid 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:05 user nova-compute[71711]: DEBUG nova.network.neutron [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:24:05 user nova-compute[71711]: DEBUG nova.policy [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '896e1c5d0edd4a1d9d122115f02dfef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d2a1b102d54e8194741137e193436f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:24:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "eb450dca-84ef-47c4-9038-9269a661bb12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "eb450dca-84ef-47c4-9038-9269a661bb12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:05 user nova-compute[71711]: DEBUG nova.objects.instance [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lazy-loading 'flavor' on Instance uuid eb450dca-84ef-47c4-9038-9269a661bb12 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "eb450dca-84ef-47c4-9038-9269a661bb12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:05 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280630.682462, 7dee97a4-9497-43c2-a688-7bedd1441885 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:24:05 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] VM Stopped (Lifecycle Event)
Apr 12 06:24:05 user nova-compute[71711]: DEBUG nova.compute.manager [None req-86c572db-301f-4a96-a483-9d115f9ac4d1 None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:24:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "eb450dca-84ef-47c4-9038-9269a661bb12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "eb450dca-84ef-47c4-9038-9269a661bb12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:05 user nova-compute[71711]: INFO nova.compute.manager [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Attaching volume e858dd17-43f2-4bb6-9d13-6f151b01bd2d to /dev/sdc
Apr 12 06:24:06 user nova-compute[71711]: DEBUG nova.network.neutron [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Successfully created port: 6cf08234-4591-4998-8bf0-c2b02614a969 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG nova.compute.manager [None req-86c572db-301f-4a96-a483-9d115f9ac4d1 None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG os_brick.utils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb88b5d-5543-4092-8a39-777f1163808c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba331ebc-7c0c-4726-b256-21d1acb3914c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[738f2c36-19df-456b-8dd8-87fbbc0f2283]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7485f964-1cdb-445c-ac01-5f1f5affbe64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:24:06 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[82243510-08a9-4e61-bf7f-3b254d0ca521]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG os_brick.utils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Updating existing volume attachment record: 4e26ccf1-d6d2-449c-ade9-f11720bb961f {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG nova.network.neutron [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Successfully updated port: 6cf08234-4591-4998-8bf0-c2b02614a969 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquired lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG nova.network.neutron [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG nova.compute.manager [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-changed-6cf08234-4591-4998-8bf0-c2b02614a969 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG nova.compute.manager [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Refreshing instance network info cache due to event network-changed-6cf08234-4591-4998-8bf0-c2b02614a969. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:24:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] Acquiring lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG nova.network.neutron [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Updating instance_info_cache with network_info: [{"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Releasing lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] Acquired lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG nova.network.neutron [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Refreshing network info cache for port 6cf08234-4591-4998-8bf0-c2b02614a969 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535299913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535299913',id=6,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsYFbAoV+s8XfUdzNJguOlyjgf5rzssGClNchETA1Wb0ZBXMDpVCtnjv4m62tZx7TC11beScEz0QICYslGhXYxCCYoznL60xxNw9+KIk2H3I9oh00SIE1sHei3bsDqqwQ==',key_name='tempest-keypair-1020989553',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='96d2a1b102d54e8194741137e193436f',ramdisk_id='',reservation_id='r-0ngl4bz5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179204824',owner_user_name='tempest-TaggedAttachmentsTest-1179204824-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896e1c5d0edd4a1d9d122115f02dfef7',uuid=1c02afd2-428b-49c9-a5e9-016fdeab1046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converting VIF {"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:15:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cf08234-4591-4998-8bf0-c2b02614a969,network=Network(45a7db3f-5232-4acd-833f-d4f7ce063b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf08234-45') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG os_vif [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:15:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cf08234-4591-4998-8bf0-c2b02614a969,network=Network(45a7db3f-5232-4acd-833f-d4f7ce063b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf08234-45') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cf08234-45, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6cf08234-45, col_values=(('external_ids', {'iface-id': '6cf08234-4591-4998-8bf0-c2b02614a969', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:15:3f', 'vm-uuid': '1c02afd2-428b-49c9-a5e9-016fdeab1046'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:07 user nova-compute[71711]: INFO os_vif [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:15:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cf08234-4591-4998-8bf0-c2b02614a969,network=Network(45a7db3f-5232-4acd-833f-d4f7ce063b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf08234-45')
Apr 12 06:24:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535299913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535299913',id=6,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsYFbAoV+s8XfUdzNJguOlyjgf5rzssGClNchETA1Wb0ZBXMDpVCtnjv4m62tZx7TC11beScEz0QICYslGhXYxCCYoznL60xxNw9+KIk2H3I9oh00SIE1sHei3bsDqqwQ==',key_name='tempest-keypair-1020989553',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='96d2a1b102d54e8194741137e193436f',ramdisk_id='',reservation_id='r-0ngl4bz5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179204824',owner_user_name='tempest-TaggedAttachmentsTest-1179204824-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896e1c5d0edd4a1d9d122115f02dfef7',uuid=1c02afd2-428b-49c9-a5e9-016fdeab1046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converting VIF {"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:15:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cf08234-4591-4998-8bf0-c2b02614a969,network=Network(45a7db3f-5232-4acd-833f-d4f7ce063b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf08234-45') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] attach device xml: <interface type="ethernet">
Apr 12 06:24:07 user nova-compute[71711]:   <mac address="fa:16:3e:c9:15:3f"/>
Apr 12 06:24:07 user nova-compute[71711]:   <model type="virtio"/>
Apr 12 06:24:07 user nova-compute[71711]:   <mtu size="1442"/>
Apr 12 06:24:07 user nova-compute[71711]:   <target dev="tap6cf08234-45"/>
Apr 12 06:24:07 user nova-compute[71711]: </interface>
Apr 12 06:24:07 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-3ed3ff09-a612-4d7b-b290-d74c7b3ba5ab req-f5f503e8-9fb9-4844-9bb5-f2243e7e99b5 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-vif-plugged-6cf08234-4591-4998-8bf0-c2b02614a969 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3ed3ff09-a612-4d7b-b290-d74c7b3ba5ab req-f5f503e8-9fb9-4844-9bb5-f2243e7e99b5 service nova] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3ed3ff09-a612-4d7b-b290-d74c7b3ba5ab req-f5f503e8-9fb9-4844-9bb5-f2243e7e99b5 service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3ed3ff09-a612-4d7b-b290-d74c7b3ba5ab req-f5f503e8-9fb9-4844-9bb5-f2243e7e99b5 service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-3ed3ff09-a612-4d7b-b290-d74c7b3ba5ab req-f5f503e8-9fb9-4844-9bb5-f2243e7e99b5 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] No waiting events found dispatching network-vif-plugged-6cf08234-4591-4998-8bf0-c2b02614a969 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:08 user nova-compute[71711]: WARNING nova.compute.manager [req-3ed3ff09-a612-4d7b-b290-d74c7b3ba5ab req-f5f503e8-9fb9-4844-9bb5-f2243e7e99b5 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received unexpected event network-vif-plugged-6cf08234-4591-4998-8bf0-c2b02614a969 for instance with vm_state active and task_state None.
Apr 12 06:24:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] No BDM found with device name hda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] No VIF found with MAC fa:16:3e:fb:fb:33, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:24:08 user nova-compute[71711]:   <nova:package version="0.0.0"/>
Apr 12 06:24:08 user nova-compute[71711]:   <nova:name>tempest-device-tagging-server-535299913</nova:name>
Apr 12 06:24:08 user nova-compute[71711]:   <nova:creationTime>2023-04-12 06:24:08</nova:creationTime>
Apr 12 06:24:08 user nova-compute[71711]:   <nova:flavor name="m1.nano">
Apr 12 06:24:08 user nova-compute[71711]:     <nova:memory>128</nova:memory>
Apr 12 06:24:08 user nova-compute[71711]:     <nova:disk>1</nova:disk>
Apr 12 06:24:08 user nova-compute[71711]:     <nova:swap>0</nova:swap>
Apr 12 06:24:08 user nova-compute[71711]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:24:08 user nova-compute[71711]:     <nova:vcpus>1</nova:vcpus>
Apr 12 06:24:08 user nova-compute[71711]:   </nova:flavor>
Apr 12 06:24:08 user nova-compute[71711]:   <nova:owner>
Apr 12 06:24:08 user nova-compute[71711]:     <nova:user uuid="896e1c5d0edd4a1d9d122115f02dfef7">tempest-TaggedAttachmentsTest-1179204824-project-member</nova:user>
Apr 12 06:24:08 user nova-compute[71711]:     <nova:project uuid="96d2a1b102d54e8194741137e193436f">tempest-TaggedAttachmentsTest-1179204824</nova:project>
Apr 12 06:24:08 user nova-compute[71711]:   </nova:owner>
Apr 12 06:24:08 user nova-compute[71711]:   <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:24:08 user nova-compute[71711]:   <nova:ports>
Apr 12 06:24:08 user nova-compute[71711]:     <nova:port uuid="e215c62b-ca21-474c-bb78-e65c3d3a6d23">
Apr 12 06:24:08 user nova-compute[71711]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:24:08 user nova-compute[71711]:     </nova:port>
Apr 12 06:24:08 user nova-compute[71711]:     <nova:port uuid="6cf08234-4591-4998-8bf0-c2b02614a969">
Apr 12 06:24:08 user nova-compute[71711]:       <nova:ip type="fixed" address="10.10.10.120" ipVersion="4"/>
Apr 12 06:24:08 user nova-compute[71711]:     </nova:port>
Apr 12 06:24:08 user nova-compute[71711]:   </nova:ports>
Apr 12 06:24:08 user nova-compute[71711]: </nova:instance>
Apr 12 06:24:08 user nova-compute[71711]:  {{(pid=71711) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG nova.network.neutron [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Updated VIF entry in instance network info cache for port 6cf08234-4591-4998-8bf0-c2b02614a969. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG nova.network.neutron [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Updating instance_info_cache with network_info: [{"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ca33aa4a-5949-4a5b-a24e-d84edf0fe70a req-d9e6a299-dc9f-4fcd-80e1-5440057af141 service nova] Releasing lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-56e68eb1-f7b7-433c-b681-365fe7678568 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "interface-1c02afd2-428b-49c9-a5e9-016fdeab1046-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.644s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG nova.objects.instance [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lazy-loading 'flavor' on Instance uuid 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:08 user nova-compute[71711]: INFO nova.compute.manager [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Attaching volume d2470870-a46d-44c2-98dc-448e98ab0866 to /dev/vdb
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "33458552-cb23-41c7-9cb7-ef13301468f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lazy-loading 'flavor' on Instance uuid 33458552-cb23-41c7-9cb7-ef13301468f6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG os_brick.utils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a580409b-7106-4f46-97b3-8fec8150f6b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[297a5a3c-57a4-4509-b524-ff374a1d2d6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3e361d-cb86-4a81-887a-bce6a3ea2aa7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bde95a-5728-4e73-8506-406b602767c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:24:09 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a73e495-b428-4930-bfec-3a7774328c3a]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG os_brick.utils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Updating existing volume attachment record: 65bf6a8b-3e34-49ff-ad75-fd08acf382a0 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "33458552-cb23-41c7-9cb7-ef13301468f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:09 user nova-compute[71711]: INFO nova.compute.manager [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Attaching volume 1872667c-83a2-4de7-a347-cc3fd70bf901 to /dev/vdb
Apr 12 06:24:09 user nova-compute[71711]: DEBUG os_brick.utils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc96f4ef-a87a-4e08-ace9-85d208efeb9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[23edb482-6e29-4bc4-8611-a99fa62b438e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78150aa-f415-44f0-acf2-bbf2a47e210a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2954710d-8566-4a4e-842f-9dbb82f6dd17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:24:09 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:24:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cb7488-3e37-4ed8-b9a0-fbbc5b4bc639]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG os_brick.utils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:09 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Updating existing volume attachment record: 0f6f8df0-a8b1-4e5f-94a8-645b131c04ed {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-vif-plugged-6cf08234-4591-4998-8bf0-c2b02614a969 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] No waiting events found dispatching network-vif-plugged-6cf08234-4591-4998-8bf0-c2b02614a969 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:10 user nova-compute[71711]: WARNING nova.compute.manager [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received unexpected event network-vif-plugged-6cf08234-4591-4998-8bf0-c2b02614a969 for instance with vm_state active and task_state None.
Apr 12 06:24:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Received event network-changed-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Refreshing instance network info cache due to event network-changed-f6ee077c-02a5-41ec-85b8-56bc6aeddd39. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] Acquiring lock "refresh_cache-33458552-cb23-41c7-9cb7-ef13301468f6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] Acquired lock "refresh_cache-33458552-cb23-41c7-9cb7-ef13301468f6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG nova.network.neutron [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Refreshing network info cache for port f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mlSGupMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:10 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:10 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:10 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aab1c4-d402-4a84-8081-fb047105e558]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:24:10 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a319b40-770e-4268-9791-c94db4f81a18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d] added
Apr 12 06:24:10 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9d2ce4-b981-45ff-8cad-7fdeacdb39ce]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82373d6-5ccb-4b97-b0ff-b7995507a20f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mlSGupMO {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mlSGupMO" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1856f9b4-10ab-447b-ae5a-f45af87231c4]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mlSGupMO'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.102s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[097ce628-9e3a-42b1-9c37-4b7873235cb1]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG nova.network.neutron [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Updated VIF entry in instance network info cache for port f6ee077c-02a5-41ec-85b8-56bc6aeddd39. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG nova.network.neutron [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Updating instance_info_cache with network_info: [{"id": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "address": "fa:16:3e:56:fb:fd", "network": {"id": "0b9e975b-f79a-4346-a4ba-543f9560aba7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1629057747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff56a846b9e34aada0c72df46d47b77d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ee077c-02", "ovs_interfaceid": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d96325-c0ba-4212-b245-ebc8898456b0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2d851315-65d9-4166-9366-684e97a05099 req-03f8d2b9-226d-403d-9167-021ae3a9413c service nova] Releasing lock "refresh_cache-33458552-cb23-41c7-9cb7-ef13301468f6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9496f30-2eae-4f24-95e3-17ab9652cff2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d, portal: 172.16.0.220,3260]
Apr 12 06:24:11 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:11 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a92b52-52a7-4de0-b790-505cbfdf3eed]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ad2113-1674-4d5c-8e2c-d9ffbe0cb287]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)
Apr 12 06:24:11 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:11 user nova-compute[71711]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)
Apr 12 06:24:11 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9698ca2f-30be-43bb-955e-46cec2d052bd]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:11 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:24:12 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:24:12 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mlSGupMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:24:12 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:12 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '26161323764326564', 'path': '/dev/sdf'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161323764326564', 'path': '/dev/sdf'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:24:12 user nova-compute[71711]: DEBUG nova.objects.instance [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lazy-loading 'flavor' on Instance uuid eb450dca-84ef-47c4-9038-9269a661bb12 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:24:12 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:24:12 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:24:12 user nova-compute[71711]:   <target dev="sdc" bus="scsi"/>
Apr 12 06:24:12 user nova-compute[71711]:   <serial>e858dd17-43f2-4bb6-9d13-6f151b01bd2d</serial>
Apr 12 06:24:12 user nova-compute[71711]:   <address type="drive" controller="0" unit="2"/>
Apr 12 06:24:12 user nova-compute[71711]: </disk>
Apr 12 06:24:12 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:24:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] No BDM found with device name sda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:24:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:24:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:24:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] No VIF found with MAC fa:16:3e:14:7c:2e, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:24:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-297cd81b-9557-4cdf-9913-1585affeb837 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "eb450dca-84ef-47c4-9038-9269a661bb12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.148s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDzhwJUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:13 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:13 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:13 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "eb450dca-84ef-47c4-9038-9269a661bb12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "eb450dca-84ef-47c4-9038-9269a661bb12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6172ab9-f530-4343-8998-949f65b76b40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:24:13 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:13 user nova-compute[71711]: INFO nova.compute.manager [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Detaching volume e858dd17-43f2-4bb6-9d13-6f151b01bd2d
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d204e8d4-d161-468f-965e-cc6dc08c1b6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866] added
Apr 12 06:24:13 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d697aa-b98c-4743-9d9a-2025e35e9aaf]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eda931-1a10-4109-b8a2-381d50ff2fd3]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDzhwJUi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:13 user nova-compute[71711]: INFO nova.virt.block_device [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Attempting to driver detach volume e858dd17-43f2-4bb6-9d13-6f151b01bd2d from mountpoint /dev/sdc
Apr 12 06:24:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Attempting to detach device sdc from instance eb450dca-84ef-47c4-9038-9269a661bb12 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:24:13 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:24:13 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:24:13 user nova-compute[71711]:   <target dev="sdc" bus="scsi"/>
Apr 12 06:24:13 user nova-compute[71711]:   <serial>e858dd17-43f2-4bb6-9d13-6f151b01bd2d</serial>
Apr 12 06:24:13 user nova-compute[71711]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 06:24:13 user nova-compute[71711]: </disk>
Apr 12 06:24:13 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDzhwJUi" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae98705-300c-4bc1-98b3-cd10fc1253d5]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cDzhwJUi'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:13 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Successfully detached device sdc from instance eb450dca-84ef-47c4-9038-9269a661bb12 from the persistent domain config.
Apr 12 06:24:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance eb450dca-84ef-47c4-9038-9269a661bb12 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:24:13 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:24:13 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:24:13 user nova-compute[71711]:   <target dev="sdc" bus="scsi"/>
Apr 12 06:24:13 user nova-compute[71711]:   <serial>e858dd17-43f2-4bb6-9d13-6f151b01bd2d</serial>
Apr 12 06:24:13 user nova-compute[71711]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 06:24:13 user nova-compute[71711]: </disk>
Apr 12 06:24:13 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7ffd7f-c5d0-4695-9c0e-4b019c01088a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f0d277-7eec-4fef-a7ab-3f380d43a930]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)
Apr 12 06:24:13 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)
Apr 12 06:24:13 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[18003304-0beb-44fc-9604-74c94fe9178b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866, portal: 172.16.0.220,3260]
Apr 12 06:24:13 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:13 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec685607-a870-49d6-9e84-0befe20f761b]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2557ca7d-92ba-4830-9b43-21399093c2bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)
Apr 12 06:24:13 user nova-compute[71711]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)
Apr 12 06:24:13 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8a9c20-8f7a-4842-9dd4-d7a8a33b85be]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDzhwJUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXLxNfBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:13 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681280653.9577603, eb450dca-84ef-47c4-9038-9269a661bb12 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance eb450dca-84ef-47c4-9038-9269a661bb12 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:24:13 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Successfully detached device sdc from instance eb450dca-84ef-47c4-9038-9269a661bb12 from the live domain config.
Apr 12 06:24:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mlSGupMO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:13 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23262393863306364', 'path': '/dev/sdh'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262393863306364', 'path': '/dev/sdh'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.970s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:14 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:14 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG nova.objects.instance [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lazy-loading 'flavor' on Instance uuid 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fb7b74-750c-4d73-8420-bd6a0b6ef803]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:24:14 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:24:14 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:24:14 user nova-compute[71711]:   <source dev="/dev/sdh"/>
Apr 12 06:24:14 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:24:14 user nova-compute[71711]:   <serial>d2470870-a46d-44c2-98dc-448e98ab0866</serial>
Apr 12 06:24:14 user nova-compute[71711]: </disk>
Apr 12 06:24:14 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c228691-3461-42ed-a284-82c84ae82564]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901] added
Apr 12 06:24:14 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7111a51b-6a8a-456c-8d62-47fbac97a57c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b542e5-89a6-447d-ae5f-4854efad727c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HXLxNfBv {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HXLxNfBv" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c8c5e8-f6e2-48b2-a9a2-8647148b0d0a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HXLxNfBv'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3470b1f1-8147-41c6-bc27-416fbd56ce7b]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[77216735-d470-4273-be27-e8924d0d0fe4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:14 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:14 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:14 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:14 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:14 user nova-compute[71711]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)
Apr 12 06:24:14 user nova-compute[71711]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)
Apr 12 06:24:14 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:14 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:14 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:14 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:14 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:14 user nova-compute[71711]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)
Apr 12 06:24:14 user nova-compute[71711]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)
Apr 12 06:24:14 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fed2916-f65f-4b25-9155-bdc12d944ebc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260]
Apr 12 06:24:15 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:15 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b26598-911d-40de-a685-d62d2d874873]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[df91ee14-5227-4610-8695-92b931b45261]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)
Apr 12 06:24:15 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)
Apr 12 06:24:15 user nova-compute[71711]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)
Apr 12 06:24:15 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3092b5f-1e83-4a9c-8df9-21c518998440]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXLxNfBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] No BDM found with device name hda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] No VIF found with MAC fa:16:3e:fb:fb:33, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:24:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-853d814b-c68d-484c-86df-84cc64c70cbe tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.448s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] <== connect_volume: return (2339ms) {'type': 'block', 'scsi_wwn': '23362623935356437', 'path': '/dev/sdi'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362623935356437', 'path': '/dev/sdi'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.199s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lazy-loading 'flavor' on Instance uuid 33458552-cb23-41c7-9cb7-ef13301468f6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5393c0-c9e6-46be-b3c2-140471274bfa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:24:16 user nova-compute[71711]: No targets found.
Apr 12 06:24:16 user nova-compute[71711]: iSNS:
Apr 12 06:24:16 user nova-compute[71711]: No targets found.
Apr 12 06:24:16 user nova-compute[71711]: STATIC:
Apr 12 06:24:16 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866
Apr 12 06:24:16 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:16 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:16 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:24:16 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:16 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:16 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3
Apr 12 06:24:16 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:16 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:16 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901
Apr 12 06:24:16 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:16 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:16 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:24:16 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:16 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:16 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29
Apr 12 06:24:16 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:16 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:16 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6
Apr 12 06:24:16 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:16 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:16 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d
Apr 12 06:24:16 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:16 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:16 user nova-compute[71711]: FIRMWARE:
Apr 12 06:24:16 user nova-compute[71711]: No targets found.
Apr 12 06:24:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:24:16 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:24:16 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:24:16 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:24:16 user nova-compute[71711]:   <source dev="/dev/sdi"/>
Apr 12 06:24:16 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:24:16 user nova-compute[71711]:   <serial>1872667c-83a2-4de7-a347-cc3fd70bf901</serial>
Apr 12 06:24:16 user nova-compute[71711]: </disk>
Apr 12 06:24:16 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[11901b8a-1eb9-4d40-b93e-1e618cd2a37c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[84abfa5a-c025-4466-8403-100626439940]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)
Apr 12 06:24:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d (non-flash)
Apr 12 06:24:16 user nova-compute[71711]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)
Apr 12 06:24:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c338a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d'): ({'sdf'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Removing single pathed devices sdf {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[19038aba-0e0d-454d-9bcd-fe7d46a51442]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7e8c62-2548-47ef-a2a0-8e1d90c0f6f3]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Flushing IO for device /dev/sdf {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae5d853-9042-4933-910a-73b68354b3c3]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[25589251-b519-437b-99a9-47883fbb20ff]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec8c7d9-c20b-4278-9c8c-8a59acf25d96]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91a6da4-7896-4c0c-8b40-a8e1bbbe9364]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d, portal: 172.16.0.220,3260]
Apr 12 06:24:16 user nova-compute[71711]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e858dd17-43f2-4bb6-9d13-6f151b01bd2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[de36972b-6e44-4df9-a9e2-0ac972143f0e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] <== disconnect_volume: return (2553ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] No VIF found with MAC fa:16:3e:56:fb:fd, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a210ba39-91ce-4939-a498-f86eb5a21793 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.492s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:16 user nova-compute[71711]: INFO nova.compute.manager [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Detaching volume d2470870-a46d-44c2-98dc-448e98ab0866
Apr 12 06:24:17 user nova-compute[71711]: INFO nova.virt.block_device [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Attempting to driver detach volume d2470870-a46d-44c2-98dc-448e98ab0866 from mountpoint /dev/vdb
Apr 12 06:24:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Attempting to detach device vdb from instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:24:17 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:24:17 user nova-compute[71711]:   <source dev="/dev/sdh"/>
Apr 12 06:24:17 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:24:17 user nova-compute[71711]:   <serial>d2470870-a46d-44c2-98dc-448e98ab0866</serial>
Apr 12 06:24:17 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 06:24:17 user nova-compute[71711]: </disk>
Apr 12 06:24:17 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:24:17 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Successfully detached device vdb from instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 from the persistent domain config.
Apr 12 06:24:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:24:17 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:24:17 user nova-compute[71711]:   <source dev="/dev/sdh"/>
Apr 12 06:24:17 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:24:17 user nova-compute[71711]:   <serial>d2470870-a46d-44c2-98dc-448e98ab0866</serial>
Apr 12 06:24:17 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 06:24:17 user nova-compute[71711]: </disk>
Apr 12 06:24:17 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lazy-loading 'flavor' on Instance uuid eb450dca-84ef-47c4-9038-9269a661bb12 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a253831f-2d2d-4930-936f-5db6092509f3 tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "eb450dca-84ef-47c4-9038-9269a661bb12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.932s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681280657.5724733, 1c02afd2-428b-49c9-a5e9-016fdeab1046 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:24:17 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Successfully detached device vdb from instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 from the live domain config.
Apr 12 06:24:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDzhwJUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:17 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea78800-cbec-4fdd-88b8-473ca9769306]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:24:17 user nova-compute[71711]: No targets found.
Apr 12 06:24:17 user nova-compute[71711]: iSNS:
Apr 12 06:24:17 user nova-compute[71711]: No targets found.
Apr 12 06:24:17 user nova-compute[71711]: STATIC:
Apr 12 06:24:17 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866
Apr 12 06:24:17 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:17 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:17 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:24:17 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:17 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:17 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3
Apr 12 06:24:17 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:17 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:17 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901
Apr 12 06:24:17 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:17 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:17 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:24:17 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:17 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:17 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29
Apr 12 06:24:17 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:17 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:17 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6
Apr 12 06:24:17 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:17 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:17 user nova-compute[71711]: FIRMWARE:
Apr 12 06:24:17 user nova-compute[71711]: No targets found.
Apr 12 06:24:17 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:24:17 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:24:17 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdf918a-78f8-4baf-b2bb-03fa9f8f2ae3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0134b652-3d33-4268-ae50-22232b88dc4b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:17 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:17 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:17 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:17 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:17 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:17 user nova-compute[71711]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)
Apr 12 06:24:17 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:17 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:17 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:17 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:17 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:17 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:17 user nova-compute[71711]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 (non-flash)
Apr 12 06:24:17 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c33bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866'): ({'sdh'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Removing single pathed devices sdh {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e14e3d-40b6-4e28-a094-eff26a00b945]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[995ce04d-e066-4d6c-96bc-97cb0f800404]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Flushing IO for device /dev/sdh {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ae458a-3a83-46e1-831b-4aacc1a9da29]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6985c641-dc5c-45c1-a3f5-3a751cadee0c]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] SCSI volumes sdh have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dd80de-990e-4484-b250-ae130052367b]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd02f65-8cdd-4075-9791-42be8bbd5cca]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866, portal: 172.16.0.220,3260]
Apr 12 06:24:17 user nova-compute[71711]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:17 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2470870-a46d-44c2-98dc-448e98ab0866 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c236dc6-1b71-448d-a683-b399575728e8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] <== disconnect_volume: return (314ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Acquiring lock "33458552-cb23-41c7-9cb7-ef13301468f6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG os_brick.utils [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0707e0-d2b9-4e65-a627-f194b82954da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "eb450dca-84ef-47c4-9038-9269a661bb12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "eb450dca-84ef-47c4-9038-9269a661bb12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:18 user nova-compute[71711]: INFO nova.compute.manager [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Terminating instance
Apr 12 06:24:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed1764d-d44a-4328-ba40-82d82fa43ff0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a3d966-b9c7-432a-a7d0-022743fe5d8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9262d1-daca-4581-bd57-84e72521641e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:24:18 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcd1738-5aa6-42d3-a98a-b9a45df2c388]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG os_brick.utils [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:18 user nova-compute[71711]: INFO nova.compute.manager [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Swapping volume 1872667c-83a2-4de7-a347-cc3fd70bf901 for a0819b26-7af7-426a-8242-84954c0851f5
Apr 12 06:24:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-28c9aed5-fbe5-4ade-92d5-d799992f7ab7 req-bf2955c8-dd0a-42d9-994d-d179fa98f95f service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Received event network-vif-unplugged-89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-28c9aed5-fbe5-4ade-92d5-d799992f7ab7 req-bf2955c8-dd0a-42d9-994d-d179fa98f95f service nova] Acquiring lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-28c9aed5-fbe5-4ade-92d5-d799992f7ab7 req-bf2955c8-dd0a-42d9-994d-d179fa98f95f service nova] Lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-28c9aed5-fbe5-4ade-92d5-d799992f7ab7 req-bf2955c8-dd0a-42d9-994d-d179fa98f95f service nova] Lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-28c9aed5-fbe5-4ade-92d5-d799992f7ab7 req-bf2955c8-dd0a-42d9-994d-d179fa98f95f service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] No waiting events found dispatching network-vif-unplugged-89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-28c9aed5-fbe5-4ade-92d5-d799992f7ab7 req-bf2955c8-dd0a-42d9-994d-d179fa98f95f service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Received event network-vif-unplugged-89d27424-e166-42ad-b7e2-1b1a3101f207 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG nova.objects.instance [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lazy-loading 'flavor' on Instance uuid 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Instance destroyed successfully.
Apr 12 06:24:18 user nova-compute[71711]: DEBUG nova.objects.instance [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lazy-loading 'resources' on Instance uuid eb450dca-84ef-47c4-9038-9269a661bb12 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f806a2c3-0eea-40bf-9dc5-9feb04c2e027 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.005s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-196824245',display_name='tempest-AttachSCSIVolumeTestJSON-server-196824245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-196824245',id=5,image_ref='28c48af4-828a-49f8-850e-cec50c5957dd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNu4v/bMjQCtjIiU2fQv/kMUV5IAIKUk3uEo2wdL9cZG/02bIvxNngSgUc7czWm6vruLEHX+C9lIzuK/6LvCcBfbYsBmwF7wSXtfMfN1bdsxihIjrXNuhUi2OQoWZocEg==',key_name='tempest-keypair-939806397',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94e95975f26a4677b628411ddb18c68c',ramdisk_id='',reservation_id='r-xwtiyupi',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='28c48af4-828a-49f8-850e-cec50c5957dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-480153316',owner_user_name='tempest-AttachSCSIVolumeTestJSON-480153316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de02e22a24944fdf952fd302b608a293',uuid=eb450dca-84ef-47c4-9038-9269a661bb12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89d27424-e166-42ad-b7e2-1b1a3101f207", "address": "fa:16:3e:14:7c:2e", "network": {"id": "6e696563-b74d-4d06-adb9-004d4c9e108d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034374773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e95975f26a4677b628411ddb18c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d27424-e1", "ovs_interfaceid": "89d27424-e166-42ad-b7e2-1b1a3101f207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Converting VIF {"id": "89d27424-e166-42ad-b7e2-1b1a3101f207", "address": "fa:16:3e:14:7c:2e", "network": {"id": "6e696563-b74d-4d06-adb9-004d4c9e108d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2034374773-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94e95975f26a4677b628411ddb18c68c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89d27424-e1", "ovs_interfaceid": "89d27424-e166-42ad-b7e2-1b1a3101f207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=89d27424-e166-42ad-b7e2-1b1a3101f207,network=Network(6e696563-b74d-4d06-adb9-004d4c9e108d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d27424-e1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG os_vif [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=89d27424-e166-42ad-b7e2-1b1a3101f207,network=Network(6e696563-b74d-4d06-adb9-004d4c9e108d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d27424-e1') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89d27424-e1, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:24:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:18 user nova-compute[71711]: INFO os_vif [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:7c:2e,bridge_name='br-int',has_traffic_filtering=True,id=89d27424-e166-42ad-b7e2-1b1a3101f207,network=Network(6e696563-b74d-4d06-adb9-004d4c9e108d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89d27424-e1')
Apr 12 06:24:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Deleting instance files /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12_del
Apr 12 06:24:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Deletion of /opt/stack/data/nova/instances/eb450dca-84ef-47c4-9038-9269a661bb12_del complete
Apr 12 06:24:18 user nova-compute[71711]: INFO nova.compute.manager [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 06:24:18 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "interface-1c02afd2-428b-49c9-a5e9-016fdeab1046-6cf08234-4591-4998-8bf0-c2b02614a969" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "interface-1c02afd2-428b-49c9-a5e9-016fdeab1046-6cf08234-4591-4998-8bf0-c2b02614a969" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.objects.instance [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lazy-loading 'flavor' on Instance uuid 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535299913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535299913',id=6,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsYFbAoV+s8XfUdzNJguOlyjgf5rzssGClNchETA1Wb0ZBXMDpVCtnjv4m62tZx7TC11beScEz0QICYslGhXYxCCYoznL60xxNw9+KIk2H3I9oh00SIE1sHei3bsDqqwQ==',key_name='tempest-keypair-1020989553',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96d2a1b102d54e8194741137e193436f',ramdisk_id='',reservation_id='r-0ngl4bz5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179204824',owner_user_name='tempest-TaggedAttachmentsTest-1179204824-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896e1c5d0edd4a1d9d122115f02dfef7',uuid=1c02afd2-428b-49c9-a5e9-016fdeab1046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converting VIF {"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:15:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cf08234-4591-4998-8bf0-c2b02614a969,network=Network(45a7db3f-5232-4acd-833f-d4f7ce063b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf08234-45') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:15:3f"/><model type="virtio"/><mtu size="1442"/><target dev="tap6cf08234-45"/></interface> {{(pid=71711) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:15:3f"/><model type="virtio"/><mtu size="1442"/><target dev="tap6cf08234-45"/></interface> {{(pid=71711) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Attempting to detach device tap6cf08234-45 from instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] detach device xml: <interface type="ethernet">
Apr 12 06:24:19 user nova-compute[71711]:   <mac address="fa:16:3e:c9:15:3f"/>
Apr 12 06:24:19 user nova-compute[71711]:   <model type="virtio"/>
Apr 12 06:24:19 user nova-compute[71711]:   <mtu size="1442"/>
Apr 12 06:24:19 user nova-compute[71711]:   <target dev="tap6cf08234-45"/>
Apr 12 06:24:19 user nova-compute[71711]: </interface>
Apr 12 06:24:19 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:15:3f"/><model type="virtio"/><mtu size="1442"/><target dev="tap6cf08234-45"/></interface> {{(pid=71711) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c9:15:3f"/><model type="virtio"/><mtu size="1442"/><target dev="tap6cf08234-45"/></interface>not found in domain: <domain type='kvm' id='6'>
Apr 12 06:24:19 user nova-compute[71711]:   <name>instance-00000006</name>
Apr 12 06:24:19 user nova-compute[71711]:   <uuid>1c02afd2-428b-49c9-a5e9-016fdeab1046</uuid>
Apr 12 06:24:19 user nova-compute[71711]:   <metadata>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:24:19 user nova-compute[71711]:   <nova:package version="0.0.0"/>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:name>tempest-device-tagging-server-535299913</nova:name>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:creationTime>2023-04-12 06:24:08</nova:creationTime>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:flavor name="m1.nano">
Apr 12 06:24:19 user nova-compute[71711]:     <nova:memory>128</nova:memory>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:disk>1</nova:disk>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:swap>0</nova:swap>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:vcpus>1</nova:vcpus>
Apr 12 06:24:19 user nova-compute[71711]:   </nova:flavor>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:owner>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:user uuid="896e1c5d0edd4a1d9d122115f02dfef7">tempest-TaggedAttachmentsTest-1179204824-project-member</nova:user>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:project uuid="96d2a1b102d54e8194741137e193436f">tempest-TaggedAttachmentsTest-1179204824</nova:project>
Apr 12 06:24:19 user nova-compute[71711]:   </nova:owner>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:ports>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:port uuid="e215c62b-ca21-474c-bb78-e65c3d3a6d23">
Apr 12 06:24:19 user nova-compute[71711]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:24:19 user nova-compute[71711]:     </nova:port>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:port uuid="6cf08234-4591-4998-8bf0-c2b02614a969">
Apr 12 06:24:19 user nova-compute[71711]:       <nova:ip type="fixed" address="10.10.10.120" ipVersion="4"/>
Apr 12 06:24:19 user nova-compute[71711]:     </nova:port>
Apr 12 06:24:19 user nova-compute[71711]:   </nova:ports>
Apr 12 06:24:19 user nova-compute[71711]: </nova:instance>
Apr 12 06:24:19 user nova-compute[71711]:   </metadata>
Apr 12 06:24:19 user nova-compute[71711]:   <memory unit='KiB'>131072</memory>
Apr 12 06:24:19 user nova-compute[71711]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 06:24:19 user nova-compute[71711]:   <vcpu placement='static'>1</vcpu>
Apr 12 06:24:19 user nova-compute[71711]:   <resource>
Apr 12 06:24:19 user nova-compute[71711]:     <partition>/machine</partition>
Apr 12 06:24:19 user nova-compute[71711]:   </resource>
Apr 12 06:24:19 user nova-compute[71711]:   <sysinfo type='smbios'>
Apr 12 06:24:19 user nova-compute[71711]:     <system>
Apr 12 06:24:19 user nova-compute[71711]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 06:24:19 user nova-compute[71711]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 06:24:19 user nova-compute[71711]:       <entry name='version'>0.0.0</entry>
Apr 12 06:24:19 user nova-compute[71711]:       <entry name='serial'>1c02afd2-428b-49c9-a5e9-016fdeab1046</entry>
Apr 12 06:24:19 user nova-compute[71711]:       <entry name='uuid'>1c02afd2-428b-49c9-a5e9-016fdeab1046</entry>
Apr 12 06:24:19 user nova-compute[71711]:       <entry name='family'>Virtual Machine</entry>
Apr 12 06:24:19 user nova-compute[71711]:     </system>
Apr 12 06:24:19 user nova-compute[71711]:   </sysinfo>
Apr 12 06:24:19 user nova-compute[71711]:   <os>
Apr 12 06:24:19 user nova-compute[71711]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 06:24:19 user nova-compute[71711]:     <boot dev='hd'/>
Apr 12 06:24:19 user nova-compute[71711]:     <smbios mode='sysinfo'/>
Apr 12 06:24:19 user nova-compute[71711]:   </os>
Apr 12 06:24:19 user nova-compute[71711]:   <features>
Apr 12 06:24:19 user nova-compute[71711]:     <acpi/>
Apr 12 06:24:19 user nova-compute[71711]:     <apic/>
Apr 12 06:24:19 user nova-compute[71711]:     <vmcoreinfo state='on'/>
Apr 12 06:24:19 user nova-compute[71711]:   </features>
Apr 12 06:24:19 user nova-compute[71711]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 06:24:19 user nova-compute[71711]:     <model fallback='forbid'>Nehalem</model>
Apr 12 06:24:19 user nova-compute[71711]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 06:24:19 user nova-compute[71711]:     <feature policy='require' name='vme'/>
Apr 12 06:24:19 user nova-compute[71711]:     <feature policy='require' name='x2apic'/>
Apr 12 06:24:19 user nova-compute[71711]:     <feature policy='require' name='hypervisor'/>
Apr 12 06:24:19 user nova-compute[71711]:   </cpu>
Apr 12 06:24:19 user nova-compute[71711]:   <clock offset='utc'>
Apr 12 06:24:19 user nova-compute[71711]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 06:24:19 user nova-compute[71711]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 06:24:19 user nova-compute[71711]:     <timer name='hpet' present='no'/>
Apr 12 06:24:19 user nova-compute[71711]:   </clock>
Apr 12 06:24:19 user nova-compute[71711]:   <on_poweroff>destroy</on_poweroff>
Apr 12 06:24:19 user nova-compute[71711]:   <on_reboot>restart</on_reboot>
Apr 12 06:24:19 user nova-compute[71711]:   <on_crash>destroy</on_crash>
Apr 12 06:24:19 user nova-compute[71711]:   <devices>
Apr 12 06:24:19 user nova-compute[71711]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 06:24:19 user nova-compute[71711]:     <disk type='file' device='disk'>
Apr 12 06:24:19 user nova-compute[71711]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 06:24:19 user nova-compute[71711]:       <source file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk' index='2'/>
Apr 12 06:24:19 user nova-compute[71711]:       <backingStore type='file' index='3'>
Apr 12 06:24:19 user nova-compute[71711]:         <format type='raw'/>
Apr 12 06:24:19 user nova-compute[71711]:         <source file='/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83'/>
Apr 12 06:24:19 user nova-compute[71711]:         <backingStore/>
Apr 12 06:24:19 user nova-compute[71711]:       </backingStore>
Apr 12 06:24:19 user nova-compute[71711]:       <target dev='vda' bus='virtio'/>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='virtio-disk0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </disk>
Apr 12 06:24:19 user nova-compute[71711]:     <disk type='file' device='cdrom'>
Apr 12 06:24:19 user nova-compute[71711]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 06:24:19 user nova-compute[71711]:       <source file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk.config' index='1'/>
Apr 12 06:24:19 user nova-compute[71711]:       <backingStore/>
Apr 12 06:24:19 user nova-compute[71711]:       <target dev='hda' bus='ide'/>
Apr 12 06:24:19 user nova-compute[71711]:       <readonly/>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='ide0-0-0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </disk>
Apr 12 06:24:19 user nova-compute[71711]:     <controller type='usb' index='0' model='none'>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='usb'/>
Apr 12 06:24:19 user nova-compute[71711]:     </controller>
Apr 12 06:24:19 user nova-compute[71711]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='pci.0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </controller>
Apr 12 06:24:19 user nova-compute[71711]:     <controller type='ide' index='0'>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='ide'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 06:24:19 user nova-compute[71711]:     </controller>
Apr 12 06:24:19 user nova-compute[71711]:     <interface type='ethernet'>
Apr 12 06:24:19 user nova-compute[71711]:       <mac address='fa:16:3e:fb:fb:33'/>
Apr 12 06:24:19 user nova-compute[71711]:       <target dev='tape215c62b-ca'/>
Apr 12 06:24:19 user nova-compute[71711]:       <model type='virtio'/>
Apr 12 06:24:19 user nova-compute[71711]:       <mtu size='1442'/>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='net0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </interface>
Apr 12 06:24:19 user nova-compute[71711]:     <interface type='ethernet'>
Apr 12 06:24:19 user nova-compute[71711]:       <mac address='fa:16:3e:c9:15:3f'/>
Apr 12 06:24:19 user nova-compute[71711]:       <target dev='tap6cf08234-45'/>
Apr 12 06:24:19 user nova-compute[71711]:       <model type='virtio'/>
Apr 12 06:24:19 user nova-compute[71711]:       <mtu size='1442'/>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='net1'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </interface>
Apr 12 06:24:19 user nova-compute[71711]:     <serial type='pty'>
Apr 12 06:24:19 user nova-compute[71711]:       <source path='/dev/pts/5'/>
Apr 12 06:24:19 user nova-compute[71711]:       <log file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/console.log' append='off'/>
Apr 12 06:24:19 user nova-compute[71711]:       <target type='isa-serial' port='0'>
Apr 12 06:24:19 user nova-compute[71711]:         <model name='isa-serial'/>
Apr 12 06:24:19 user nova-compute[71711]:       </target>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='serial0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </serial>
Apr 12 06:24:19 user nova-compute[71711]:     <console type='pty' tty='/dev/pts/5'>
Apr 12 06:24:19 user nova-compute[71711]:       <source path='/dev/pts/5'/>
Apr 12 06:24:19 user nova-compute[71711]:       <log file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/console.log' append='off'/>
Apr 12 06:24:19 user nova-compute[71711]:       <target type='serial' port='0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='serial0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </console>
Apr 12 06:24:19 user nova-compute[71711]:     <input type='mouse' bus='ps2'>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='input0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </input>
Apr 12 06:24:19 user nova-compute[71711]:     <input type='keyboard' bus='ps2'>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='input1'/>
Apr 12 06:24:19 user nova-compute[71711]:     </input>
Apr 12 06:24:19 user nova-compute[71711]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Apr 12 06:24:19 user nova-compute[71711]:       <listen type='address' address='0.0.0.0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </graphics>
Apr 12 06:24:19 user nova-compute[71711]:     <audio id='1' type='none'/>
Apr 12 06:24:19 user nova-compute[71711]:     <video>
Apr 12 06:24:19 user nova-compute[71711]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='video0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </video>
Apr 12 06:24:19 user nova-compute[71711]:     <memballoon model='virtio'>
Apr 12 06:24:19 user nova-compute[71711]:       <stats period='10'/>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='balloon0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </memballoon>
Apr 12 06:24:19 user nova-compute[71711]:     <rng model='virtio'>
Apr 12 06:24:19 user nova-compute[71711]:       <backend model='random'>/dev/urandom</backend>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='rng0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </rng>
Apr 12 06:24:19 user nova-compute[71711]:   </devices>
Apr 12 06:24:19 user nova-compute[71711]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 06:24:19 user nova-compute[71711]:     <label>libvirt-1c02afd2-428b-49c9-a5e9-016fdeab1046</label>
Apr 12 06:24:19 user nova-compute[71711]:     <imagelabel>libvirt-1c02afd2-428b-49c9-a5e9-016fdeab1046</imagelabel>
Apr 12 06:24:19 user nova-compute[71711]:   </seclabel>
Apr 12 06:24:19 user nova-compute[71711]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 06:24:19 user nova-compute[71711]:     <label>+64055:+108</label>
Apr 12 06:24:19 user nova-compute[71711]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 06:24:19 user nova-compute[71711]:   </seclabel>
Apr 12 06:24:19 user nova-compute[71711]: </domain>
Apr 12 06:24:19 user nova-compute[71711]:  {{(pid=71711) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 06:24:19 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Successfully detached device tap6cf08234-45 from instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 from the persistent domain config.
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] (1/8): Attempting to detach device tap6cf08234-45 with device alias net1 from instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] detach device xml: <interface type="ethernet">
Apr 12 06:24:19 user nova-compute[71711]:   <mac address="fa:16:3e:c9:15:3f"/>
Apr 12 06:24:19 user nova-compute[71711]:   <model type="virtio"/>
Apr 12 06:24:19 user nova-compute[71711]:   <mtu size="1442"/>
Apr 12 06:24:19 user nova-compute[71711]:   <target dev="tap6cf08234-45"/>
Apr 12 06:24:19 user nova-compute[71711]: </interface>
Apr 12 06:24:19 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681280659.5616806, 1c02afd2-428b-49c9-a5e9-016fdeab1046 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Start waiting for the detach event from libvirt for device tap6cf08234-45 with device alias net1 for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:15:3f"/><model type="virtio"/><mtu size="1442"/><target dev="tap6cf08234-45"/></interface> {{(pid=71711) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c9:15:3f"/><model type="virtio"/><mtu size="1442"/><target dev="tap6cf08234-45"/></interface>not found in domain: <domain type='kvm' id='6'>
Apr 12 06:24:19 user nova-compute[71711]:   <name>instance-00000006</name>
Apr 12 06:24:19 user nova-compute[71711]:   <uuid>1c02afd2-428b-49c9-a5e9-016fdeab1046</uuid>
Apr 12 06:24:19 user nova-compute[71711]:   <metadata>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:24:19 user nova-compute[71711]:   <nova:package version="0.0.0"/>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:name>tempest-device-tagging-server-535299913</nova:name>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:creationTime>2023-04-12 06:24:08</nova:creationTime>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:flavor name="m1.nano">
Apr 12 06:24:19 user nova-compute[71711]:     <nova:memory>128</nova:memory>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:disk>1</nova:disk>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:swap>0</nova:swap>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:vcpus>1</nova:vcpus>
Apr 12 06:24:19 user nova-compute[71711]:   </nova:flavor>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:owner>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:user uuid="896e1c5d0edd4a1d9d122115f02dfef7">tempest-TaggedAttachmentsTest-1179204824-project-member</nova:user>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:project uuid="96d2a1b102d54e8194741137e193436f">tempest-TaggedAttachmentsTest-1179204824</nova:project>
Apr 12 06:24:19 user nova-compute[71711]:   </nova:owner>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:ports>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:port uuid="e215c62b-ca21-474c-bb78-e65c3d3a6d23">
Apr 12 06:24:19 user nova-compute[71711]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:24:19 user nova-compute[71711]:     </nova:port>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:port uuid="6cf08234-4591-4998-8bf0-c2b02614a969">
Apr 12 06:24:19 user nova-compute[71711]:       <nova:ip type="fixed" address="10.10.10.120" ipVersion="4"/>
Apr 12 06:24:19 user nova-compute[71711]:     </nova:port>
Apr 12 06:24:19 user nova-compute[71711]:   </nova:ports>
Apr 12 06:24:19 user nova-compute[71711]: </nova:instance>
Apr 12 06:24:19 user nova-compute[71711]:   </metadata>
Apr 12 06:24:19 user nova-compute[71711]:   <memory unit='KiB'>131072</memory>
Apr 12 06:24:19 user nova-compute[71711]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 06:24:19 user nova-compute[71711]:   <vcpu placement='static'>1</vcpu>
Apr 12 06:24:19 user nova-compute[71711]:   <resource>
Apr 12 06:24:19 user nova-compute[71711]:     <partition>/machine</partition>
Apr 12 06:24:19 user nova-compute[71711]:   </resource>
Apr 12 06:24:19 user nova-compute[71711]:   <sysinfo type='smbios'>
Apr 12 06:24:19 user nova-compute[71711]:     <system>
Apr 12 06:24:19 user nova-compute[71711]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 06:24:19 user nova-compute[71711]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 06:24:19 user nova-compute[71711]:       <entry name='version'>0.0.0</entry>
Apr 12 06:24:19 user nova-compute[71711]:       <entry name='serial'>1c02afd2-428b-49c9-a5e9-016fdeab1046</entry>
Apr 12 06:24:19 user nova-compute[71711]:       <entry name='uuid'>1c02afd2-428b-49c9-a5e9-016fdeab1046</entry>
Apr 12 06:24:19 user nova-compute[71711]:       <entry name='family'>Virtual Machine</entry>
Apr 12 06:24:19 user nova-compute[71711]:     </system>
Apr 12 06:24:19 user nova-compute[71711]:   </sysinfo>
Apr 12 06:24:19 user nova-compute[71711]:   <os>
Apr 12 06:24:19 user nova-compute[71711]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 06:24:19 user nova-compute[71711]:     <boot dev='hd'/>
Apr 12 06:24:19 user nova-compute[71711]:     <smbios mode='sysinfo'/>
Apr 12 06:24:19 user nova-compute[71711]:   </os>
Apr 12 06:24:19 user nova-compute[71711]:   <features>
Apr 12 06:24:19 user nova-compute[71711]:     <acpi/>
Apr 12 06:24:19 user nova-compute[71711]:     <apic/>
Apr 12 06:24:19 user nova-compute[71711]:     <vmcoreinfo state='on'/>
Apr 12 06:24:19 user nova-compute[71711]:   </features>
Apr 12 06:24:19 user nova-compute[71711]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 06:24:19 user nova-compute[71711]:     <model fallback='forbid'>Nehalem</model>
Apr 12 06:24:19 user nova-compute[71711]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 06:24:19 user nova-compute[71711]:     <feature policy='require' name='vme'/>
Apr 12 06:24:19 user nova-compute[71711]:     <feature policy='require' name='x2apic'/>
Apr 12 06:24:19 user nova-compute[71711]:     <feature policy='require' name='hypervisor'/>
Apr 12 06:24:19 user nova-compute[71711]:   </cpu>
Apr 12 06:24:19 user nova-compute[71711]:   <clock offset='utc'>
Apr 12 06:24:19 user nova-compute[71711]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 06:24:19 user nova-compute[71711]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 06:24:19 user nova-compute[71711]:     <timer name='hpet' present='no'/>
Apr 12 06:24:19 user nova-compute[71711]:   </clock>
Apr 12 06:24:19 user nova-compute[71711]:   <on_poweroff>destroy</on_poweroff>
Apr 12 06:24:19 user nova-compute[71711]:   <on_reboot>restart</on_reboot>
Apr 12 06:24:19 user nova-compute[71711]:   <on_crash>destroy</on_crash>
Apr 12 06:24:19 user nova-compute[71711]:   <devices>
Apr 12 06:24:19 user nova-compute[71711]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 06:24:19 user nova-compute[71711]:     <disk type='file' device='disk'>
Apr 12 06:24:19 user nova-compute[71711]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 06:24:19 user nova-compute[71711]:       <source file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk' index='2'/>
Apr 12 06:24:19 user nova-compute[71711]:       <backingStore type='file' index='3'>
Apr 12 06:24:19 user nova-compute[71711]:         <format type='raw'/>
Apr 12 06:24:19 user nova-compute[71711]:         <source file='/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83'/>
Apr 12 06:24:19 user nova-compute[71711]:         <backingStore/>
Apr 12 06:24:19 user nova-compute[71711]:       </backingStore>
Apr 12 06:24:19 user nova-compute[71711]:       <target dev='vda' bus='virtio'/>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='virtio-disk0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </disk>
Apr 12 06:24:19 user nova-compute[71711]:     <disk type='file' device='cdrom'>
Apr 12 06:24:19 user nova-compute[71711]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 06:24:19 user nova-compute[71711]:       <source file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk.config' index='1'/>
Apr 12 06:24:19 user nova-compute[71711]:       <backingStore/>
Apr 12 06:24:19 user nova-compute[71711]:       <target dev='hda' bus='ide'/>
Apr 12 06:24:19 user nova-compute[71711]:       <readonly/>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='ide0-0-0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </disk>
Apr 12 06:24:19 user nova-compute[71711]:     <controller type='usb' index='0' model='none'>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='usb'/>
Apr 12 06:24:19 user nova-compute[71711]:     </controller>
Apr 12 06:24:19 user nova-compute[71711]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='pci.0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </controller>
Apr 12 06:24:19 user nova-compute[71711]:     <controller type='ide' index='0'>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='ide'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 06:24:19 user nova-compute[71711]:     </controller>
Apr 12 06:24:19 user nova-compute[71711]:     <interface type='ethernet'>
Apr 12 06:24:19 user nova-compute[71711]:       <mac address='fa:16:3e:fb:fb:33'/>
Apr 12 06:24:19 user nova-compute[71711]:       <target dev='tape215c62b-ca'/>
Apr 12 06:24:19 user nova-compute[71711]:       <model type='virtio'/>
Apr 12 06:24:19 user nova-compute[71711]:       <mtu size='1442'/>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='net0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </interface>
Apr 12 06:24:19 user nova-compute[71711]:     <serial type='pty'>
Apr 12 06:24:19 user nova-compute[71711]:       <source path='/dev/pts/5'/>
Apr 12 06:24:19 user nova-compute[71711]:       <log file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/console.log' append='off'/>
Apr 12 06:24:19 user nova-compute[71711]:       <target type='isa-serial' port='0'>
Apr 12 06:24:19 user nova-compute[71711]:         <model name='isa-serial'/>
Apr 12 06:24:19 user nova-compute[71711]:       </target>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='serial0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </serial>
Apr 12 06:24:19 user nova-compute[71711]:     <console type='pty' tty='/dev/pts/5'>
Apr 12 06:24:19 user nova-compute[71711]:       <source path='/dev/pts/5'/>
Apr 12 06:24:19 user nova-compute[71711]:       <log file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/console.log' append='off'/>
Apr 12 06:24:19 user nova-compute[71711]:       <target type='serial' port='0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='serial0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </console>
Apr 12 06:24:19 user nova-compute[71711]:     <input type='mouse' bus='ps2'>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='input0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </input>
Apr 12 06:24:19 user nova-compute[71711]:     <input type='keyboard' bus='ps2'>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='input1'/>
Apr 12 06:24:19 user nova-compute[71711]:     </input>
Apr 12 06:24:19 user nova-compute[71711]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Apr 12 06:24:19 user nova-compute[71711]:       <listen type='address' address='0.0.0.0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </graphics>
Apr 12 06:24:19 user nova-compute[71711]:     <audio id='1' type='none'/>
Apr 12 06:24:19 user nova-compute[71711]:     <video>
Apr 12 06:24:19 user nova-compute[71711]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='video0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </video>
Apr 12 06:24:19 user nova-compute[71711]:     <memballoon model='virtio'>
Apr 12 06:24:19 user nova-compute[71711]:       <stats period='10'/>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='balloon0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </memballoon>
Apr 12 06:24:19 user nova-compute[71711]:     <rng model='virtio'>
Apr 12 06:24:19 user nova-compute[71711]:       <backend model='random'>/dev/urandom</backend>
Apr 12 06:24:19 user nova-compute[71711]:       <alias name='rng0'/>
Apr 12 06:24:19 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 06:24:19 user nova-compute[71711]:     </rng>
Apr 12 06:24:19 user nova-compute[71711]:   </devices>
Apr 12 06:24:19 user nova-compute[71711]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 06:24:19 user nova-compute[71711]:     <label>libvirt-1c02afd2-428b-49c9-a5e9-016fdeab1046</label>
Apr 12 06:24:19 user nova-compute[71711]:     <imagelabel>libvirt-1c02afd2-428b-49c9-a5e9-016fdeab1046</imagelabel>
Apr 12 06:24:19 user nova-compute[71711]:   </seclabel>
Apr 12 06:24:19 user nova-compute[71711]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 06:24:19 user nova-compute[71711]:     <label>+64055:+108</label>
Apr 12 06:24:19 user nova-compute[71711]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 06:24:19 user nova-compute[71711]:   </seclabel>
Apr 12 06:24:19 user nova-compute[71711]: </domain>
Apr 12 06:24:19 user nova-compute[71711]:  {{(pid=71711) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 06:24:19 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Successfully detached device tap6cf08234-45 from instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 from the live domain config.
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535299913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535299913',id=6,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsYFbAoV+s8XfUdzNJguOlyjgf5rzssGClNchETA1Wb0ZBXMDpVCtnjv4m62tZx7TC11beScEz0QICYslGhXYxCCYoznL60xxNw9+KIk2H3I9oh00SIE1sHei3bsDqqwQ==',key_name='tempest-keypair-1020989553',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96d2a1b102d54e8194741137e193436f',ramdisk_id='',reservation_id='r-0ngl4bz5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179204824',owner_user_name='tempest-TaggedAttachmentsTest-1179204824-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896e1c5d0edd4a1d9d122115f02dfef7',uuid=1c02afd2-428b-49c9-a5e9-016fdeab1046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converting VIF {"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:15:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cf08234-4591-4998-8bf0-c2b02614a969,network=Network(45a7db3f-5232-4acd-833f-d4f7ce063b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf08234-45') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG os_vif [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:15:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cf08234-4591-4998-8bf0-c2b02614a969,network=Network(45a7db3f-5232-4acd-833f-d4f7ce063b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf08234-45') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cf08234-45, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:19 user nova-compute[71711]: INFO os_vif [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:15:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cf08234-4591-4998-8bf0-c2b02614a969,network=Network(45a7db3f-5232-4acd-833f-d4f7ce063b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf08234-45')
Apr 12 06:24:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:24:19 user nova-compute[71711]:   <nova:package version="0.0.0"/>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:name>tempest-device-tagging-server-535299913</nova:name>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:creationTime>2023-04-12 06:24:19</nova:creationTime>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:flavor name="m1.nano">
Apr 12 06:24:19 user nova-compute[71711]:     <nova:memory>128</nova:memory>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:disk>1</nova:disk>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:swap>0</nova:swap>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:vcpus>1</nova:vcpus>
Apr 12 06:24:19 user nova-compute[71711]:   </nova:flavor>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:owner>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:user uuid="896e1c5d0edd4a1d9d122115f02dfef7">tempest-TaggedAttachmentsTest-1179204824-project-member</nova:user>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:project uuid="96d2a1b102d54e8194741137e193436f">tempest-TaggedAttachmentsTest-1179204824</nova:project>
Apr 12 06:24:19 user nova-compute[71711]:   </nova:owner>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:24:19 user nova-compute[71711]:   <nova:ports>
Apr 12 06:24:19 user nova-compute[71711]:     <nova:port uuid="e215c62b-ca21-474c-bb78-e65c3d3a6d23">
Apr 12 06:24:19 user nova-compute[71711]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:24:19 user nova-compute[71711]:     </nova:port>
Apr 12 06:24:19 user nova-compute[71711]:   </nova:ports>
Apr 12 06:24:19 user nova-compute[71711]: </nova:instance>
Apr 12 06:24:19 user nova-compute[71711]:  {{(pid=71711) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-vif-deleted-6cf08234-4591-4998-8bf0-c2b02614a969 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:20 user nova-compute[71711]: INFO nova.compute.manager [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Neutron deleted interface 6cf08234-4591-4998-8bf0-c2b02614a969; detaching it from the instance and deleting it from the info cache
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.network.neutron [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Updating instance_info_cache with network_info: [{"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquired lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.network.neutron [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.objects.instance [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] Lazy-loading 'system_metadata' on Instance uuid 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.objects.instance [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] Lazy-loading 'flavor' on Instance uuid 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535299913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535299913',id=6,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsYFbAoV+s8XfUdzNJguOlyjgf5rzssGClNchETA1Wb0ZBXMDpVCtnjv4m62tZx7TC11beScEz0QICYslGhXYxCCYoznL60xxNw9+KIk2H3I9oh00SIE1sHei3bsDqqwQ==',key_name='tempest-keypair-1020989553',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96d2a1b102d54e8194741137e193436f',ramdisk_id='',reservation_id='r-0ngl4bz5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179204824',owner_user_name='tempest-TaggedAttachmentsTest-1179204824-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896e1c5d0edd4a1d9d122115f02dfef7',uuid=1c02afd2-428b-49c9-a5e9-016fdeab1046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.network.os_vif_util [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] Converting VIF {"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.network.os_vif_util [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:15:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cf08234-4591-4998-8bf0-c2b02614a969,network=Network(45a7db3f-5232-4acd-833f-d4f7ce063b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf08234-45') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:15:3f"/><model type="virtio"/><mtu size="1442"/><target dev="tap6cf08234-45"/></interface> {{(pid=71711) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c9:15:3f"/><model type="virtio"/><mtu size="1442"/><target dev="tap6cf08234-45"/></interface>not found in domain: <domain type='kvm' id='6'>
Apr 12 06:24:20 user nova-compute[71711]:   <name>instance-00000006</name>
Apr 12 06:24:20 user nova-compute[71711]:   <uuid>1c02afd2-428b-49c9-a5e9-016fdeab1046</uuid>
Apr 12 06:24:20 user nova-compute[71711]:   <metadata>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:24:20 user nova-compute[71711]:   <nova:package version="0.0.0"/>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:name>tempest-device-tagging-server-535299913</nova:name>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:creationTime>2023-04-12 06:24:19</nova:creationTime>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:flavor name="m1.nano">
Apr 12 06:24:20 user nova-compute[71711]:     <nova:memory>128</nova:memory>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:disk>1</nova:disk>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:swap>0</nova:swap>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:vcpus>1</nova:vcpus>
Apr 12 06:24:20 user nova-compute[71711]:   </nova:flavor>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:owner>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:user uuid="896e1c5d0edd4a1d9d122115f02dfef7">tempest-TaggedAttachmentsTest-1179204824-project-member</nova:user>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:project uuid="96d2a1b102d54e8194741137e193436f">tempest-TaggedAttachmentsTest-1179204824</nova:project>
Apr 12 06:24:20 user nova-compute[71711]:   </nova:owner>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:ports>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:port uuid="e215c62b-ca21-474c-bb78-e65c3d3a6d23">
Apr 12 06:24:20 user nova-compute[71711]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:24:20 user nova-compute[71711]:     </nova:port>
Apr 12 06:24:20 user nova-compute[71711]:   </nova:ports>
Apr 12 06:24:20 user nova-compute[71711]: </nova:instance>
Apr 12 06:24:20 user nova-compute[71711]:   </metadata>
Apr 12 06:24:20 user nova-compute[71711]:   <memory unit='KiB'>131072</memory>
Apr 12 06:24:20 user nova-compute[71711]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 06:24:20 user nova-compute[71711]:   <vcpu placement='static'>1</vcpu>
Apr 12 06:24:20 user nova-compute[71711]:   <resource>
Apr 12 06:24:20 user nova-compute[71711]:     <partition>/machine</partition>
Apr 12 06:24:20 user nova-compute[71711]:   </resource>
Apr 12 06:24:20 user nova-compute[71711]:   <sysinfo type='smbios'>
Apr 12 06:24:20 user nova-compute[71711]:     <system>
Apr 12 06:24:20 user nova-compute[71711]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 06:24:20 user nova-compute[71711]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 06:24:20 user nova-compute[71711]:       <entry name='version'>0.0.0</entry>
Apr 12 06:24:20 user nova-compute[71711]:       <entry name='serial'>1c02afd2-428b-49c9-a5e9-016fdeab1046</entry>
Apr 12 06:24:20 user nova-compute[71711]:       <entry name='uuid'>1c02afd2-428b-49c9-a5e9-016fdeab1046</entry>
Apr 12 06:24:20 user nova-compute[71711]:       <entry name='family'>Virtual Machine</entry>
Apr 12 06:24:20 user nova-compute[71711]:     </system>
Apr 12 06:24:20 user nova-compute[71711]:   </sysinfo>
Apr 12 06:24:20 user nova-compute[71711]:   <os>
Apr 12 06:24:20 user nova-compute[71711]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 06:24:20 user nova-compute[71711]:     <boot dev='hd'/>
Apr 12 06:24:20 user nova-compute[71711]:     <smbios mode='sysinfo'/>
Apr 12 06:24:20 user nova-compute[71711]:   </os>
Apr 12 06:24:20 user nova-compute[71711]:   <features>
Apr 12 06:24:20 user nova-compute[71711]:     <acpi/>
Apr 12 06:24:20 user nova-compute[71711]:     <apic/>
Apr 12 06:24:20 user nova-compute[71711]:     <vmcoreinfo state='on'/>
Apr 12 06:24:20 user nova-compute[71711]:   </features>
Apr 12 06:24:20 user nova-compute[71711]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 06:24:20 user nova-compute[71711]:     <model fallback='forbid'>Nehalem</model>
Apr 12 06:24:20 user nova-compute[71711]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 06:24:20 user nova-compute[71711]:     <feature policy='require' name='vme'/>
Apr 12 06:24:20 user nova-compute[71711]:     <feature policy='require' name='x2apic'/>
Apr 12 06:24:20 user nova-compute[71711]:     <feature policy='require' name='hypervisor'/>
Apr 12 06:24:20 user nova-compute[71711]:   </cpu>
Apr 12 06:24:20 user nova-compute[71711]:   <clock offset='utc'>
Apr 12 06:24:20 user nova-compute[71711]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 06:24:20 user nova-compute[71711]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 06:24:20 user nova-compute[71711]:     <timer name='hpet' present='no'/>
Apr 12 06:24:20 user nova-compute[71711]:   </clock>
Apr 12 06:24:20 user nova-compute[71711]:   <on_poweroff>destroy</on_poweroff>
Apr 12 06:24:20 user nova-compute[71711]:   <on_reboot>restart</on_reboot>
Apr 12 06:24:20 user nova-compute[71711]:   <on_crash>destroy</on_crash>
Apr 12 06:24:20 user nova-compute[71711]:   <devices>
Apr 12 06:24:20 user nova-compute[71711]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 06:24:20 user nova-compute[71711]:     <disk type='file' device='disk'>
Apr 12 06:24:20 user nova-compute[71711]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 06:24:20 user nova-compute[71711]:       <source file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk' index='2'/>
Apr 12 06:24:20 user nova-compute[71711]:       <backingStore type='file' index='3'>
Apr 12 06:24:20 user nova-compute[71711]:         <format type='raw'/>
Apr 12 06:24:20 user nova-compute[71711]:         <source file='/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83'/>
Apr 12 06:24:20 user nova-compute[71711]:         <backingStore/>
Apr 12 06:24:20 user nova-compute[71711]:       </backingStore>
Apr 12 06:24:20 user nova-compute[71711]:       <target dev='vda' bus='virtio'/>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='virtio-disk0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </disk>
Apr 12 06:24:20 user nova-compute[71711]:     <disk type='file' device='cdrom'>
Apr 12 06:24:20 user nova-compute[71711]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 06:24:20 user nova-compute[71711]:       <source file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk.config' index='1'/>
Apr 12 06:24:20 user nova-compute[71711]:       <backingStore/>
Apr 12 06:24:20 user nova-compute[71711]:       <target dev='hda' bus='ide'/>
Apr 12 06:24:20 user nova-compute[71711]:       <readonly/>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='ide0-0-0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </disk>
Apr 12 06:24:20 user nova-compute[71711]:     <controller type='usb' index='0' model='none'>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='usb'/>
Apr 12 06:24:20 user nova-compute[71711]:     </controller>
Apr 12 06:24:20 user nova-compute[71711]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='pci.0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </controller>
Apr 12 06:24:20 user nova-compute[71711]:     <controller type='ide' index='0'>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='ide'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 06:24:20 user nova-compute[71711]:     </controller>
Apr 12 06:24:20 user nova-compute[71711]:     <interface type='ethernet'>
Apr 12 06:24:20 user nova-compute[71711]:       <mac address='fa:16:3e:fb:fb:33'/>
Apr 12 06:24:20 user nova-compute[71711]:       <target dev='tape215c62b-ca'/>
Apr 12 06:24:20 user nova-compute[71711]:       <model type='virtio'/>
Apr 12 06:24:20 user nova-compute[71711]:       <mtu size='1442'/>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='net0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </interface>
Apr 12 06:24:20 user nova-compute[71711]:     <serial type='pty'>
Apr 12 06:24:20 user nova-compute[71711]:       <source path='/dev/pts/5'/>
Apr 12 06:24:20 user nova-compute[71711]:       <log file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/console.log' append='off'/>
Apr 12 06:24:20 user nova-compute[71711]:       <target type='isa-serial' port='0'>
Apr 12 06:24:20 user nova-compute[71711]:         <model name='isa-serial'/>
Apr 12 06:24:20 user nova-compute[71711]:       </target>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='serial0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </serial>
Apr 12 06:24:20 user nova-compute[71711]:     <console type='pty' tty='/dev/pts/5'>
Apr 12 06:24:20 user nova-compute[71711]:       <source path='/dev/pts/5'/>
Apr 12 06:24:20 user nova-compute[71711]:       <log file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/console.log' append='off'/>
Apr 12 06:24:20 user nova-compute[71711]:       <target type='serial' port='0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='serial0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </console>
Apr 12 06:24:20 user nova-compute[71711]:     <input type='mouse' bus='ps2'>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='input0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </input>
Apr 12 06:24:20 user nova-compute[71711]:     <input type='keyboard' bus='ps2'>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='input1'/>
Apr 12 06:24:20 user nova-compute[71711]:     </input>
Apr 12 06:24:20 user nova-compute[71711]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Apr 12 06:24:20 user nova-compute[71711]:       <listen type='address' address='0.0.0.0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </graphics>
Apr 12 06:24:20 user nova-compute[71711]:     <audio id='1' type='none'/>
Apr 12 06:24:20 user nova-compute[71711]:     <video>
Apr 12 06:24:20 user nova-compute[71711]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='video0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </video>
Apr 12 06:24:20 user nova-compute[71711]:     <memballoon model='virtio'>
Apr 12 06:24:20 user nova-compute[71711]:       <stats period='10'/>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='balloon0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </memballoon>
Apr 12 06:24:20 user nova-compute[71711]:     <rng model='virtio'>
Apr 12 06:24:20 user nova-compute[71711]:       <backend model='random'>/dev/urandom</backend>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='rng0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </rng>
Apr 12 06:24:20 user nova-compute[71711]:   </devices>
Apr 12 06:24:20 user nova-compute[71711]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 06:24:20 user nova-compute[71711]:     <label>libvirt-1c02afd2-428b-49c9-a5e9-016fdeab1046</label>
Apr 12 06:24:20 user nova-compute[71711]:     <imagelabel>libvirt-1c02afd2-428b-49c9-a5e9-016fdeab1046</imagelabel>
Apr 12 06:24:20 user nova-compute[71711]:   </seclabel>
Apr 12 06:24:20 user nova-compute[71711]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 06:24:20 user nova-compute[71711]:     <label>+64055:+108</label>
Apr 12 06:24:20 user nova-compute[71711]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 06:24:20 user nova-compute[71711]:   </seclabel>
Apr 12 06:24:20 user nova-compute[71711]: </domain>
Apr 12 06:24:20 user nova-compute[71711]:  {{(pid=71711) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c9:15:3f"/><model type="virtio"/><mtu size="1442"/><target dev="tap6cf08234-45"/></interface> {{(pid=71711) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c9:15:3f"/><model type="virtio"/><mtu size="1442"/><target dev="tap6cf08234-45"/></interface>not found in domain: <domain type='kvm' id='6'>
Apr 12 06:24:20 user nova-compute[71711]:   <name>instance-00000006</name>
Apr 12 06:24:20 user nova-compute[71711]:   <uuid>1c02afd2-428b-49c9-a5e9-016fdeab1046</uuid>
Apr 12 06:24:20 user nova-compute[71711]:   <metadata>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:24:20 user nova-compute[71711]:   <nova:package version="0.0.0"/>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:name>tempest-device-tagging-server-535299913</nova:name>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:creationTime>2023-04-12 06:24:19</nova:creationTime>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:flavor name="m1.nano">
Apr 12 06:24:20 user nova-compute[71711]:     <nova:memory>128</nova:memory>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:disk>1</nova:disk>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:swap>0</nova:swap>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:vcpus>1</nova:vcpus>
Apr 12 06:24:20 user nova-compute[71711]:   </nova:flavor>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:owner>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:user uuid="896e1c5d0edd4a1d9d122115f02dfef7">tempest-TaggedAttachmentsTest-1179204824-project-member</nova:user>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:project uuid="96d2a1b102d54e8194741137e193436f">tempest-TaggedAttachmentsTest-1179204824</nova:project>
Apr 12 06:24:20 user nova-compute[71711]:   </nova:owner>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:ports>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:port uuid="e215c62b-ca21-474c-bb78-e65c3d3a6d23">
Apr 12 06:24:20 user nova-compute[71711]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:24:20 user nova-compute[71711]:     </nova:port>
Apr 12 06:24:20 user nova-compute[71711]:   </nova:ports>
Apr 12 06:24:20 user nova-compute[71711]: </nova:instance>
Apr 12 06:24:20 user nova-compute[71711]:   </metadata>
Apr 12 06:24:20 user nova-compute[71711]:   <memory unit='KiB'>131072</memory>
Apr 12 06:24:20 user nova-compute[71711]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 06:24:20 user nova-compute[71711]:   <vcpu placement='static'>1</vcpu>
Apr 12 06:24:20 user nova-compute[71711]:   <resource>
Apr 12 06:24:20 user nova-compute[71711]:     <partition>/machine</partition>
Apr 12 06:24:20 user nova-compute[71711]:   </resource>
Apr 12 06:24:20 user nova-compute[71711]:   <sysinfo type='smbios'>
Apr 12 06:24:20 user nova-compute[71711]:     <system>
Apr 12 06:24:20 user nova-compute[71711]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 06:24:20 user nova-compute[71711]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 06:24:20 user nova-compute[71711]:       <entry name='version'>0.0.0</entry>
Apr 12 06:24:20 user nova-compute[71711]:       <entry name='serial'>1c02afd2-428b-49c9-a5e9-016fdeab1046</entry>
Apr 12 06:24:20 user nova-compute[71711]:       <entry name='uuid'>1c02afd2-428b-49c9-a5e9-016fdeab1046</entry>
Apr 12 06:24:20 user nova-compute[71711]:       <entry name='family'>Virtual Machine</entry>
Apr 12 06:24:20 user nova-compute[71711]:     </system>
Apr 12 06:24:20 user nova-compute[71711]:   </sysinfo>
Apr 12 06:24:20 user nova-compute[71711]:   <os>
Apr 12 06:24:20 user nova-compute[71711]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 06:24:20 user nova-compute[71711]:     <boot dev='hd'/>
Apr 12 06:24:20 user nova-compute[71711]:     <smbios mode='sysinfo'/>
Apr 12 06:24:20 user nova-compute[71711]:   </os>
Apr 12 06:24:20 user nova-compute[71711]:   <features>
Apr 12 06:24:20 user nova-compute[71711]:     <acpi/>
Apr 12 06:24:20 user nova-compute[71711]:     <apic/>
Apr 12 06:24:20 user nova-compute[71711]:     <vmcoreinfo state='on'/>
Apr 12 06:24:20 user nova-compute[71711]:   </features>
Apr 12 06:24:20 user nova-compute[71711]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 06:24:20 user nova-compute[71711]:     <model fallback='forbid'>Nehalem</model>
Apr 12 06:24:20 user nova-compute[71711]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 06:24:20 user nova-compute[71711]:     <feature policy='require' name='vme'/>
Apr 12 06:24:20 user nova-compute[71711]:     <feature policy='require' name='x2apic'/>
Apr 12 06:24:20 user nova-compute[71711]:     <feature policy='require' name='hypervisor'/>
Apr 12 06:24:20 user nova-compute[71711]:   </cpu>
Apr 12 06:24:20 user nova-compute[71711]:   <clock offset='utc'>
Apr 12 06:24:20 user nova-compute[71711]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 06:24:20 user nova-compute[71711]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 06:24:20 user nova-compute[71711]:     <timer name='hpet' present='no'/>
Apr 12 06:24:20 user nova-compute[71711]:   </clock>
Apr 12 06:24:20 user nova-compute[71711]:   <on_poweroff>destroy</on_poweroff>
Apr 12 06:24:20 user nova-compute[71711]:   <on_reboot>restart</on_reboot>
Apr 12 06:24:20 user nova-compute[71711]:   <on_crash>destroy</on_crash>
Apr 12 06:24:20 user nova-compute[71711]:   <devices>
Apr 12 06:24:20 user nova-compute[71711]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 06:24:20 user nova-compute[71711]:     <disk type='file' device='disk'>
Apr 12 06:24:20 user nova-compute[71711]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 06:24:20 user nova-compute[71711]:       <source file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk' index='2'/>
Apr 12 06:24:20 user nova-compute[71711]:       <backingStore type='file' index='3'>
Apr 12 06:24:20 user nova-compute[71711]:         <format type='raw'/>
Apr 12 06:24:20 user nova-compute[71711]:         <source file='/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83'/>
Apr 12 06:24:20 user nova-compute[71711]:         <backingStore/>
Apr 12 06:24:20 user nova-compute[71711]:       </backingStore>
Apr 12 06:24:20 user nova-compute[71711]:       <target dev='vda' bus='virtio'/>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='virtio-disk0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </disk>
Apr 12 06:24:20 user nova-compute[71711]:     <disk type='file' device='cdrom'>
Apr 12 06:24:20 user nova-compute[71711]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 06:24:20 user nova-compute[71711]:       <source file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk.config' index='1'/>
Apr 12 06:24:20 user nova-compute[71711]:       <backingStore/>
Apr 12 06:24:20 user nova-compute[71711]:       <target dev='hda' bus='ide'/>
Apr 12 06:24:20 user nova-compute[71711]:       <readonly/>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='ide0-0-0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </disk>
Apr 12 06:24:20 user nova-compute[71711]:     <controller type='usb' index='0' model='none'>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='usb'/>
Apr 12 06:24:20 user nova-compute[71711]:     </controller>
Apr 12 06:24:20 user nova-compute[71711]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='pci.0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </controller>
Apr 12 06:24:20 user nova-compute[71711]:     <controller type='ide' index='0'>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='ide'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 06:24:20 user nova-compute[71711]:     </controller>
Apr 12 06:24:20 user nova-compute[71711]:     <interface type='ethernet'>
Apr 12 06:24:20 user nova-compute[71711]:       <mac address='fa:16:3e:fb:fb:33'/>
Apr 12 06:24:20 user nova-compute[71711]:       <target dev='tape215c62b-ca'/>
Apr 12 06:24:20 user nova-compute[71711]:       <model type='virtio'/>
Apr 12 06:24:20 user nova-compute[71711]:       <mtu size='1442'/>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='net0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </interface>
Apr 12 06:24:20 user nova-compute[71711]:     <serial type='pty'>
Apr 12 06:24:20 user nova-compute[71711]:       <source path='/dev/pts/5'/>
Apr 12 06:24:20 user nova-compute[71711]:       <log file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/console.log' append='off'/>
Apr 12 06:24:20 user nova-compute[71711]:       <target type='isa-serial' port='0'>
Apr 12 06:24:20 user nova-compute[71711]:         <model name='isa-serial'/>
Apr 12 06:24:20 user nova-compute[71711]:       </target>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='serial0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </serial>
Apr 12 06:24:20 user nova-compute[71711]:     <console type='pty' tty='/dev/pts/5'>
Apr 12 06:24:20 user nova-compute[71711]:       <source path='/dev/pts/5'/>
Apr 12 06:24:20 user nova-compute[71711]:       <log file='/opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/console.log' append='off'/>
Apr 12 06:24:20 user nova-compute[71711]:       <target type='serial' port='0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='serial0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </console>
Apr 12 06:24:20 user nova-compute[71711]:     <input type='mouse' bus='ps2'>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='input0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </input>
Apr 12 06:24:20 user nova-compute[71711]:     <input type='keyboard' bus='ps2'>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='input1'/>
Apr 12 06:24:20 user nova-compute[71711]:     </input>
Apr 12 06:24:20 user nova-compute[71711]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Apr 12 06:24:20 user nova-compute[71711]:       <listen type='address' address='0.0.0.0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </graphics>
Apr 12 06:24:20 user nova-compute[71711]:     <audio id='1' type='none'/>
Apr 12 06:24:20 user nova-compute[71711]:     <video>
Apr 12 06:24:20 user nova-compute[71711]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='video0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </video>
Apr 12 06:24:20 user nova-compute[71711]:     <memballoon model='virtio'>
Apr 12 06:24:20 user nova-compute[71711]:       <stats period='10'/>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='balloon0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </memballoon>
Apr 12 06:24:20 user nova-compute[71711]:     <rng model='virtio'>
Apr 12 06:24:20 user nova-compute[71711]:       <backend model='random'>/dev/urandom</backend>
Apr 12 06:24:20 user nova-compute[71711]:       <alias name='rng0'/>
Apr 12 06:24:20 user nova-compute[71711]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 06:24:20 user nova-compute[71711]:     </rng>
Apr 12 06:24:20 user nova-compute[71711]:   </devices>
Apr 12 06:24:20 user nova-compute[71711]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 06:24:20 user nova-compute[71711]:     <label>libvirt-1c02afd2-428b-49c9-a5e9-016fdeab1046</label>
Apr 12 06:24:20 user nova-compute[71711]:     <imagelabel>libvirt-1c02afd2-428b-49c9-a5e9-016fdeab1046</imagelabel>
Apr 12 06:24:20 user nova-compute[71711]:   </seclabel>
Apr 12 06:24:20 user nova-compute[71711]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 06:24:20 user nova-compute[71711]:     <label>+64055:+108</label>
Apr 12 06:24:20 user nova-compute[71711]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 06:24:20 user nova-compute[71711]:   </seclabel>
Apr 12 06:24:20 user nova-compute[71711]: </domain>
Apr 12 06:24:20 user nova-compute[71711]:  {{(pid=71711) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 06:24:20 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Detaching interface fa:16:3e:c9:15:3f failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap6cf08234-45' not found.
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535299913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535299913',id=6,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsYFbAoV+s8XfUdzNJguOlyjgf5rzssGClNchETA1Wb0ZBXMDpVCtnjv4m62tZx7TC11beScEz0QICYslGhXYxCCYoznL60xxNw9+KIk2H3I9oh00SIE1sHei3bsDqqwQ==',key_name='tempest-keypair-1020989553',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96d2a1b102d54e8194741137e193436f',ramdisk_id='',reservation_id='r-0ngl4bz5',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179204824',owner_user_name='tempest-TaggedAttachmentsTest-1179204824-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896e1c5d0edd4a1d9d122115f02dfef7',uuid=1c02afd2-428b-49c9-a5e9-016fdeab1046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.network.os_vif_util [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] Converting VIF {"id": "6cf08234-4591-4998-8bf0-c2b02614a969", "address": "fa:16:3e:c9:15:3f", "network": {"id": "45a7db3f-5232-4acd-833f-d4f7ce063b1e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-200480062", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cf08234-45", "ovs_interfaceid": "6cf08234-4591-4998-8bf0-c2b02614a969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.network.os_vif_util [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:15:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cf08234-4591-4998-8bf0-c2b02614a969,network=Network(45a7db3f-5232-4acd-833f-d4f7ce063b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf08234-45') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG os_vif [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:15:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cf08234-4591-4998-8bf0-c2b02614a969,network=Network(45a7db3f-5232-4acd-833f-d4f7ce063b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf08234-45') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cf08234-45, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:24:20 user nova-compute[71711]: INFO os_vif [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:15:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cf08234-4591-4998-8bf0-c2b02614a969,network=Network(45a7db3f-5232-4acd-833f-d4f7ce063b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cf08234-45')
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [req-aab1cb84-a4d7-4572-a53b-170ee067666c req-91f3d4e4-534b-4daa-adf1-c4bc8bcc2f4e service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:24:20 user nova-compute[71711]:   <nova:package version="0.0.0"/>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:name>tempest-device-tagging-server-535299913</nova:name>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:creationTime>2023-04-12 06:24:20</nova:creationTime>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:flavor name="m1.nano">
Apr 12 06:24:20 user nova-compute[71711]:     <nova:memory>128</nova:memory>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:disk>1</nova:disk>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:swap>0</nova:swap>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:vcpus>1</nova:vcpus>
Apr 12 06:24:20 user nova-compute[71711]:   </nova:flavor>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:owner>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:user uuid="896e1c5d0edd4a1d9d122115f02dfef7">tempest-TaggedAttachmentsTest-1179204824-project-member</nova:user>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:project uuid="96d2a1b102d54e8194741137e193436f">tempest-TaggedAttachmentsTest-1179204824</nova:project>
Apr 12 06:24:20 user nova-compute[71711]:   </nova:owner>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:24:20 user nova-compute[71711]:   <nova:ports>
Apr 12 06:24:20 user nova-compute[71711]:     <nova:port uuid="e215c62b-ca21-474c-bb78-e65c3d3a6d23">
Apr 12 06:24:20 user nova-compute[71711]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:24:20 user nova-compute[71711]:     </nova:port>
Apr 12 06:24:20 user nova-compute[71711]:   </nova:ports>
Apr 12 06:24:20 user nova-compute[71711]: </nova:instance>
Apr 12 06:24:20 user nova-compute[71711]:  {{(pid=71711) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 06:24:20 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Took 1.41 seconds to deallocate network for instance.
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-d2fa0b08-ccf5-4fe7-8683-57b4d2afebf9 req-0a377bc6-4f7a-44d5-9aac-fad07aac8bd3 service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Received event network-vif-deleted-89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Received event network-vif-plugged-89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Acquiring lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Lock "eb450dca-84ef-47c4-9038-9269a661bb12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] No waiting events found dispatching network-vif-plugged-89d27424-e166-42ad-b7e2-1b1a3101f207 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:20 user nova-compute[71711]: WARNING nova.compute.manager [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Received unexpected event network-vif-plugged-89d27424-e166-42ad-b7e2-1b1a3101f207 for instance with vm_state deleted and task_state None.
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-vif-unplugged-6cf08234-4591-4998-8bf0-c2b02614a969 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] No waiting events found dispatching network-vif-unplugged-6cf08234-4591-4998-8bf0-c2b02614a969 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:20 user nova-compute[71711]: WARNING nova.compute.manager [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received unexpected event network-vif-unplugged-6cf08234-4591-4998-8bf0-c2b02614a969 for instance with vm_state active and task_state None.
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-vif-plugged-6cf08234-4591-4998-8bf0-c2b02614a969 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] No waiting events found dispatching network-vif-plugged-6cf08234-4591-4998-8bf0-c2b02614a969 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:20 user nova-compute[71711]: WARNING nova.compute.manager [req-f1aef7e4-2506-41c9-bfcf-4ad4823f985f req-30d6dcdb-9b63-4fa6-9d68-d85e15cda68f service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received unexpected event network-vif-plugged-6cf08234-4591-4998-8bf0-c2b02614a969 for instance with vm_state active and task_state None.
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.network.neutron [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Updating instance_info_cache with network_info: [{"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Releasing lock "refresh_cache-1c02afd2-428b-49c9-a5e9-016fdeab1046" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5c53a01-d337-489b-93d2-07735f90f1f1 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "interface-1c02afd2-428b-49c9-a5e9-016fdeab1046-6cf08234-4591-4998-8bf0-c2b02614a969" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.521s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:20 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Deleted allocations for instance eb450dca-84ef-47c4-9038-9269a661bb12
Apr 12 06:24:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b718c7cf-9ee4-4957-ba97-16ff0e3d014f tempest-AttachSCSIVolumeTestJSON-480153316 tempest-AttachSCSIVolumeTestJSON-480153316-project-member] Lock "eb450dca-84ef-47c4-9038-9269a661bb12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.823s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYNAnVgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33458552-cb23-41c7-9cb7-ef13301468f6', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0819b26-7af7-426a-8242-84954c0851f5', 'serial': 'a0819b26-7af7-426a-8242-84954c0851f5'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXLxNfBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '33458552-cb23-41c7-9cb7-ef13301468f6', 'attached_at': '', 'detached_at': '', 'volume_id': '1872667c-83a2-4de7-a347-cc3fd70bf901', 'serial'} {{(pid=71711) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYNAnVgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:22 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:22 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:22 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf5522-f9f4-470c-afea-f44aa0141b4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:24:22 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b71a70-2b9f-41ff-b3e0-09e4b657d02e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5] added
Apr 12 06:24:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1ab1e5-4207-487b-a82b-b2cc6ccafe0b]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4621894-64be-4c34-8255-f35fe67df05c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYNAnVgZ {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYNAnVgZ" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf6b69f-5ca4-4d3c-adde-5c34ed2b90b3]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uYNAnVgZ'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e759e4c-af2f-4af5-b756-b631fa31166f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6636e1c-ea01-4d12-bc9f-6ba2f9dd0a07]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0597ddc-e8c8-4bd4-8661-2895f68a3be7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5, portal: 172.16.0.220,3260]
Apr 12 06:24:22 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f877d5-fc38-45db-8d1b-7a86d38ab895]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8763343-026c-4337-aa36-fffcd1e57d14]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:22 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:24:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eacef3-7605-4111-b82e-db1b925c9ef7]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:23 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:24:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYNAnVgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:24:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23366356431306161', 'path': '/dev/sdf'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:24 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366356431306161', 'path': '/dev/sdf'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:24:24 user nova-compute[71711]: DEBUG nova.objects.instance [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lazy-loading 'flavor' on Instance uuid 33458552-cb23-41c7-9cb7-ef13301468f6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:24 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 121634816 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 263192576 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 446693376 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 611319808 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 800063488 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 981467136 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXLxNfBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:28 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcfcd4a-7e0a-403f-b092-9ee19ea31bc6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:24:28 user nova-compute[71711]: No targets found.
Apr 12 06:24:28 user nova-compute[71711]: iSNS:
Apr 12 06:24:28 user nova-compute[71711]: No targets found.
Apr 12 06:24:28 user nova-compute[71711]: STATIC:
Apr 12 06:24:28 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5
Apr 12 06:24:28 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:28 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:28 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:24:28 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:28 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:28 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3
Apr 12 06:24:28 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:28 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:28 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901
Apr 12 06:24:28 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:28 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:28 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:24:28 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:28 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:28 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29
Apr 12 06:24:28 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:28 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:28 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6
Apr 12 06:24:28 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:28 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:28 user nova-compute[71711]: FIRMWARE:
Apr 12 06:24:28 user nova-compute[71711]: No targets found.
Apr 12 06:24:28 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:24:28 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:24:28 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4eed7b-17cf-4889-9507-cd2d8a64a65c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f8a120-a861-4d4d-bd43-d49aca89e7be]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:28 user nova-compute[71711]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:28 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:28 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:28 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:28 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:28 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:28 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:28 user nova-compute[71711]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:28 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:28 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:28 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:28 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:28 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:28 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c3389d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901'): ({'sdi'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Removing single pathed devices sdi {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbcac9f-7ea1-404b-9882-3f774457b3e8]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[801500aa-44c9-4022-95b5-095a06f65079]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Flushing IO for device /dev/sdi {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c040917-59d9-4bac-9f5c-21a3baca6983]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.055s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ab6cd1-6848-4b72-b5ac-8f4bb65bd38b]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] SCSI volumes sdi have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[76329203-7b94-4caf-aeac-136b4c5c3bf6]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77fd1a2-d764-4992-83c5-a9f406572923]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260]
Apr 12 06:24:28 user nova-compute[71711]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:28 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9378f3-37c8-4509-8af8-fd59b5d8ed18]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] <== disconnect_volume: return (344ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYNAnVgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '33458552-cb23-41c7-9cb7-ef13301468f6', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0819b26-7af7-426a-8242-84954c0851f5', 'serial'} {{(pid=71711) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 06:24:28 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] swap_volume: removing Cinder connection for volume 1872667c-83a2-4de7-a347-cc3fd70bf901 {{(pid=71711) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 06:24:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] swap_volume: Updating volume 1872667c-83a2-4de7-a347-cc3fd70bf901 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "uYNAnVgZ", "auth_password": "w1iTt2v9XKO8Dd", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "a0819b26-7af7-426a-8242-84954c0851f5"}, "status": "reserved", "instance": "33458552-cb23-41c7-9cb7-ef13301468f6", "attached_at": "", "detached_at": "", "volume_id": "a0819b26-7af7-426a-8242-84954c0851f5", "serial": "a0819b26-7af7-426a-8242-84954c0851f5"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a0819b26-7af7-426a-8242-84954c0851f5', 'no_device': None, 'attachment_id': 'e287a0c7-28c8-418b-94f8-e9b79604e049'} {{(pid=71711) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 06:24:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f8b153b-6a1e-4c84-92c8-435007fe8589 tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.427s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Acquiring lock "33458552-cb23-41c7-9cb7-ef13301468f6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG os_brick.utils [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30c5f3f-0d94-448c-a4fc-32a18f514803]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0793282-84ce-420d-9680-e2aeaa7bd3d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c37bef5-49e4-4245-aa7d-73918bf67a23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8115f14d-db45-49b1-982a-d1bf7402eacb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:24:30 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:24:30 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aa0c20-ea2b-45de-a31b-1896fd6105a1]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:24:30 user nova-compute[71711]: DEBUG os_brick.utils [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:30 user nova-compute[71711]: INFO nova.compute.manager [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Swapping volume a0819b26-7af7-426a-8242-84954c0851f5 for 1872667c-83a2-4de7-a347-cc3fd70bf901
Apr 12 06:24:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:33 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280658.89388, eb450dca-84ef-47c4-9038-9269a661bb12 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:24:33 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] VM Stopped (Lifecycle Event)
Apr 12 06:24:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:33 user nova-compute[71711]: DEBUG nova.compute.manager [None req-92c0f2c5-dd5c-4753-a063-d72fa5271081 None None] [instance: eb450dca-84ef-47c4-9038-9269a661bb12] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:24:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Received event network-changed-039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Refreshing instance network info cache due to event network-changed-039ecba8-673d-41c4-a5bd-f5671896c181. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:24:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] Acquiring lock "refresh_cache-a528e600-7358-4b92-9b71-12759f405b38" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:24:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] Acquired lock "refresh_cache-a528e600-7358-4b92-9b71-12759f405b38" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:24:34 user nova-compute[71711]: DEBUG nova.network.neutron [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Refreshing network info cache for port 039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:24:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXLxNfBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33458552-cb23-41c7-9cb7-ef13301468f6', 'attached_at': '', 'detached_at': '', 'volume_id': '1872667c-83a2-4de7-a347-cc3fd70bf901', 'serial': '1872667c-83a2-4de7-a347-cc3fd70bf901'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYNAnVgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'a0819b26-7af7-426a-8242-84954c0851f5'}, 'status': 'reserved', 'instance': '33458552-cb23-41c7-9cb7-ef13301468f6', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0819b26-7af7-426a-8242-84954c0851f5', 'serial'} {{(pid=71711) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 06:24:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:24:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXLxNfBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:34 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:34 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:34 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:24:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b760752-78cc-4834-b6c0-2a47e8d27b71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:24:35 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[11111bf6-7264-440f-a7e1-af2512ee0199]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901] added
Apr 12 06:24:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8a4e87-75f0-47c4-acc1-102f7b7c4961]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "a528e600-7358-4b92-9b71-12759f405b38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "a528e600-7358-4b92-9b71-12759f405b38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9dcc57-7e8b-4baf-bcce-464daae26906]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HXLxNfBv {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG nova.objects.instance [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'flavor' on Instance uuid a528e600-7358-4b92-9b71-12759f405b38 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HXLxNfBv" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[56984a51-45ed-4a94-a23a-e7c7484d897e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HXLxNfBv'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d329e22-633c-43fc-8526-2e65d6ee6408]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "a528e600-7358-4b92-9b71-12759f405b38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4b461c-38b9-4546-b8d1-851dcd0bc443]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99363c7-56a8-4be2-81a4-212541fc4d15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260]
Apr 12 06:24:35 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[82538411-7e87-443c-8850-d2d982c26314]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-changed-55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing instance network info cache due to event network-changed-55fc6a3a-a62f-406f-9583-f4168544b133. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] Acquiring lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] Acquired lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG nova.network.neutron [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Refreshing network info cache for port 55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72acfba-fb09-4be8-99ac-35deb23ddf34]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "a528e600-7358-4b92-9b71-12759f405b38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "a528e600-7358-4b92-9b71-12759f405b38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:35 user nova-compute[71711]: INFO nova.compute.manager [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Attaching volume 7b336ad6-910c-4dd4-8ef4-c16d440e9881 to /dev/vdb
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:35 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0638ca92-16e9-4d41-9a36-1cd7d35fe41d]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.utils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8498e6-0cf6-4d30-bf58-85ebc1473d33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG nova.network.neutron [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Updated VIF entry in instance network info cache for port 039ecba8-673d-41c4-a5bd-f5671896c181. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG nova.network.neutron [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Updating instance_info_cache with network_info: [{"id": "039ecba8-673d-41c4-a5bd-f5671896c181", "address": "fa:16:3e:d6:d7:ba", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039ecba8-67", "ovs_interfaceid": "039ecba8-673d-41c4-a5bd-f5671896c181", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9680bffd-52e9-4582-90da-ed70a19a8ec5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b110f13-256f-4e82-bfb8-e104515f84b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-538248f4-27d0-4eb1-87d5-a5ef9a9e9e1b req-cfc4669c-a4a9-4e57-ae60-3f9cd21b5f4c service nova] Releasing lock "refresh_cache-a528e600-7358-4b92-9b71-12759f405b38" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb26446b-aa21-45f4-aa3c-a962cb5047ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:24:35 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:24:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44c7e7e-dce5-4fde-a15b-45e80a0210c0]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG os_brick.utils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:35 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Updating existing volume attachment record: 073792bc-2ca3-491d-969b-0732a67f3a76 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:24:36 user nova-compute[71711]: DEBUG nova.network.neutron [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updated VIF entry in instance network info cache for port 55fc6a3a-a62f-406f-9583-f4168544b133. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:24:36 user nova-compute[71711]: DEBUG nova.network.neutron [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating instance_info_cache with network_info: [{"id": "55fc6a3a-a62f-406f-9583-f4168544b133", "address": "fa:16:3e:d3:88:42", "network": {"id": "6c8f984a-0a0e-4909-9a98-c4055a889b2b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-51661518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fc6a3a-a6", "ovs_interfaceid": "55fc6a3a-a62f-406f-9583-f4168544b133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48b06cf1-3d27-423d-a0fb-952c396a727c", "address": "fa:16:3e:e5:98:cb", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b06cf1-3d", "ovs_interfaceid": "48b06cf1-3d27-423d-a0fb-952c396a727c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "address": "fa:16:3e:13:66:36", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1684f1e7-b9", "ovs_interfaceid": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f984771f-43c1-4565-8e7f-34d142b19801", "address": "fa:16:3e:cf:c5:ab", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf984771f-43", "ovs_interfaceid": "f984771f-43c1-4565-8e7f-34d142b19801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ee43811-1303-4a84-8bd4-0de882daac34", "address": "fa:16:3e:37:23:e2", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee43811-13", "ovs_interfaceid": "6ee43811-1303-4a84-8bd4-0de882daac34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "address": "fa:16:3e:e5:63:8c", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1585d729-d8", "ovs_interfaceid": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "address": "fa:16:3e:0b:4f:d7", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b7b070-9e", "ovs_interfaceid": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-12765320-6499-43fd-bcf2-8765099265a8 req-adc51749-a64c-421c-9d85-c1b0b3d3bd57 service nova] Releasing lock "refresh_cache-7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:24:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:24:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXLxNfBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:24:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23362623935356437', 'path': '/dev/sdh'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362623935356437', 'path': '/dev/sdh'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:24:36 user nova-compute[71711]: DEBUG nova.objects.instance [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lazy-loading 'flavor' on Instance uuid 33458552-cb23-41c7-9cb7-ef13301468f6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:37 user nova-compute[71711]: INFO nova.compute.manager [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Terminating instance
Apr 12 06:24:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 144703488 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-b1df48c9-15f0-4f79-8efa-f2ba4c43cbf0 req-f605ea44-4674-4957-8ba0-523303c78631 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-48b06cf1-3d27-423d-a0fb-952c396a727c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b1df48c9-15f0-4f79-8efa-f2ba4c43cbf0 req-f605ea44-4674-4957-8ba0-523303c78631 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b1df48c9-15f0-4f79-8efa-f2ba4c43cbf0 req-f605ea44-4674-4957-8ba0-523303c78631 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b1df48c9-15f0-4f79-8efa-f2ba4c43cbf0 req-f605ea44-4674-4957-8ba0-523303c78631 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-b1df48c9-15f0-4f79-8efa-f2ba4c43cbf0 req-f605ea44-4674-4957-8ba0-523303c78631 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-unplugged-48b06cf1-3d27-423d-a0fb-952c396a727c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-b1df48c9-15f0-4f79-8efa-f2ba4c43cbf0 req-f605ea44-4674-4957-8ba0-523303c78631 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-48b06cf1-3d27-423d-a0fb-952c396a727c for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 306184192 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-7713a4df-d84c-4495-aee8-33ddfc821df6 req-34fd72b1-f634-4d30-a840-02aa5c3de191 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7713a4df-d84c-4495-aee8-33ddfc821df6 req-34fd72b1-f634-4d30-a840-02aa5c3de191 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7713a4df-d84c-4495-aee8-33ddfc821df6 req-34fd72b1-f634-4d30-a840-02aa5c3de191 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7713a4df-d84c-4495-aee8-33ddfc821df6 req-34fd72b1-f634-4d30-a840-02aa5c3de191 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-7713a4df-d84c-4495-aee8-33ddfc821df6 req-34fd72b1-f634-4d30-a840-02aa5c3de191 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-unplugged-55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-7713a4df-d84c-4495-aee8-33ddfc821df6 req-34fd72b1-f634-4d30-a840-02aa5c3de191 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-55fc6a3a-a62f-406f-9583-f4168544b133 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-f29b949d-627d-4717-af54-4bad5d9afe3a req-882984d4-6ac5-4fdc-a8ef-d67f8c7d5805 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-f984771f-43c1-4565-8e7f-34d142b19801 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f29b949d-627d-4717-af54-4bad5d9afe3a req-882984d4-6ac5-4fdc-a8ef-d67f8c7d5805 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f29b949d-627d-4717-af54-4bad5d9afe3a req-882984d4-6ac5-4fdc-a8ef-d67f8c7d5805 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f29b949d-627d-4717-af54-4bad5d9afe3a req-882984d4-6ac5-4fdc-a8ef-d67f8c7d5805 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-f29b949d-627d-4717-af54-4bad5d9afe3a req-882984d4-6ac5-4fdc-a8ef-d67f8c7d5805 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-unplugged-f984771f-43c1-4565-8e7f-34d142b19801 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-f29b949d-627d-4717-af54-4bad5d9afe3a req-882984d4-6ac5-4fdc-a8ef-d67f8c7d5805 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-f984771f-43c1-4565-8e7f-34d142b19801 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 459276288 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 615514112 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:38 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Instance destroyed successfully.
Apr 12 06:24:38 user nova-compute[71711]: DEBUG nova.objects.instance [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lazy-loading 'resources' on Instance uuid 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:23:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55fc6a3a-a62f-406f-9583-f4168544b133", "address": "fa:16:3e:d3:88:42", "network": {"id": "6c8f984a-0a0e-4909-9a98-c4055a889b2b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-51661518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fc6a3a-a6", "ovs_interfaceid": "55fc6a3a-a62f-406f-9583-f4168544b133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "55fc6a3a-a62f-406f-9583-f4168544b133", "address": "fa:16:3e:d3:88:42", "network": {"id": "6c8f984a-0a0e-4909-9a98-c4055a889b2b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-51661518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55fc6a3a-a6", "ovs_interfaceid": "55fc6a3a-a62f-406f-9583-f4168544b133", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:88:42,bridge_name='br-int',has_traffic_filtering=True,id=55fc6a3a-a62f-406f-9583-f4168544b133,network=Network(6c8f984a-0a0e-4909-9a98-c4055a889b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fc6a3a-a6') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:88:42,bridge_name='br-int',has_traffic_filtering=True,id=55fc6a3a-a62f-406f-9583-f4168544b133,network=Network(6c8f984a-0a0e-4909-9a98-c4055a889b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fc6a3a-a6') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55fc6a3a-a6, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: INFO os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:88:42,bridge_name='br-int',has_traffic_filtering=True,id=55fc6a3a-a62f-406f-9583-f4168544b133,network=Network(6c8f984a-0a0e-4909-9a98-c4055a889b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55fc6a3a-a6')
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:23:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48b06cf1-3d27-423d-a0fb-952c396a727c", "address": "fa:16:3e:e5:98:cb", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b06cf1-3d", "ovs_interfaceid": "48b06cf1-3d27-423d-a0fb-952c396a727c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "48b06cf1-3d27-423d-a0fb-952c396a727c", "address": "fa:16:3e:e5:98:cb", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b06cf1-3d", "ovs_interfaceid": "48b06cf1-3d27-423d-a0fb-952c396a727c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:98:cb,bridge_name='br-int',has_traffic_filtering=True,id=48b06cf1-3d27-423d-a0fb-952c396a727c,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48b06cf1-3d') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:98:cb,bridge_name='br-int',has_traffic_filtering=True,id=48b06cf1-3d27-423d-a0fb-952c396a727c,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48b06cf1-3d') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48b06cf1-3d, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 763363328 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: INFO os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:98:cb,bridge_name='br-int',has_traffic_filtering=True,id=48b06cf1-3d27-423d-a0fb-952c396a727c,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48b06cf1-3d')
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:23:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "address": "fa:16:3e:13:66:36", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1684f1e7-b9", "ovs_interfaceid": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "address": "fa:16:3e:13:66:36", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1684f1e7-b9", "ovs_interfaceid": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:66:36,bridge_name='br-int',has_traffic_filtering=True,id=1684f1e7-b9c2-4228-8809-ebaae1ed41c7,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1684f1e7-b9') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:66:36,bridge_name='br-int',has_traffic_filtering=True,id=1684f1e7-b9c2-4228-8809-ebaae1ed41c7,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1684f1e7-b9') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1684f1e7-b9, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: INFO os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:66:36,bridge_name='br-int',has_traffic_filtering=True,id=1684f1e7-b9c2-4228-8809-ebaae1ed41c7,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1684f1e7-b9')
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:23:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f984771f-43c1-4565-8e7f-34d142b19801", "address": "fa:16:3e:cf:c5:ab", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf984771f-43", "ovs_interfaceid": "f984771f-43c1-4565-8e7f-34d142b19801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "f984771f-43c1-4565-8e7f-34d142b19801", "address": "fa:16:3e:cf:c5:ab", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf984771f-43", "ovs_interfaceid": "f984771f-43c1-4565-8e7f-34d142b19801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c5:ab,bridge_name='br-int',has_traffic_filtering=True,id=f984771f-43c1-4565-8e7f-34d142b19801,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf984771f-43') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c5:ab,bridge_name='br-int',has_traffic_filtering=True,id=f984771f-43c1-4565-8e7f-34d142b19801,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf984771f-43') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf984771f-43, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: INFO os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c5:ab,bridge_name='br-int',has_traffic_filtering=True,id=f984771f-43c1-4565-8e7f-34d142b19801,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf984771f-43')
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:23:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ee43811-1303-4a84-8bd4-0de882daac34", "address": "fa:16:3e:37:23:e2", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee43811-13", "ovs_interfaceid": "6ee43811-1303-4a84-8bd4-0de882daac34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "6ee43811-1303-4a84-8bd4-0de882daac34", "address": "fa:16:3e:37:23:e2", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee43811-13", "ovs_interfaceid": "6ee43811-1303-4a84-8bd4-0de882daac34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ee43811-1303-4a84-8bd4-0de882daac34,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee43811-13') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ee43811-1303-4a84-8bd4-0de882daac34,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee43811-13') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ee43811-13, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: INFO os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:e2,bridge_name='br-int',has_traffic_filtering=True,id=6ee43811-1303-4a84-8bd4-0de882daac34,network=Network(c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ee43811-13')
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:23:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "address": "fa:16:3e:e5:63:8c", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1585d729-d8", "ovs_interfaceid": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "address": "fa:16:3e:e5:63:8c", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1585d729-d8", "ovs_interfaceid": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:63:8c,bridge_name='br-int',has_traffic_filtering=True,id=1585d729-d8e7-44e3-b0d6-2367ec0fb1cb,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1585d729-d8') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:63:8c,bridge_name='br-int',has_traffic_filtering=True,id=1585d729-d8e7-44e3-b0d6-2367ec0fb1cb,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1585d729-d8') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1585d729-d8, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: INFO os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:63:8c,bridge_name='br-int',has_traffic_filtering=True,id=1585d729-d8e7-44e3-b0d6-2367ec0fb1cb,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1585d729-d8')
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-235005928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-235005928',id=9,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7dTrdCjKcBP/w6zDZ7gDfo1Sy0G0QqvVo49BFg9o8rSbp1ibbGJM+mo9SlGQBU8/gmB/07375N2biBCXWKu4R06158Q+uWY1a0EcPUJ4Z3RvGALmkQi9i4ZOUS8QDIDg==',key_name='tempest-keypair-1379416665',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:23:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e313922ba234462285d20a4f1f2d88d0',ramdisk_id='',reservation_id='r-nwxskg09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197354508',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197354508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='977b800fab264446b0492c93b0dc12d3',uuid=7133ac6b-6627-4aaa-86f9-9ac3c8f8139b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "address": "fa:16:3e:0b:4f:d7", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b7b070-9e", "ovs_interfaceid": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converting VIF {"id": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "address": "fa:16:3e:0b:4f:d7", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b7b070-9e", "ovs_interfaceid": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=22b7b070-9ef1-402f-8cbc-50684b0dad1c,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b7b070-9e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=22b7b070-9ef1-402f-8cbc-50684b0dad1c,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b7b070-9e') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22b7b070-9e, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-48b06cf1-3d27-423d-a0fb-952c396a727c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-48b06cf1-3d27-423d-a0fb-952c396a727c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:39 user nova-compute[71711]: WARNING nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-48b06cf1-3d27-423d-a0fb-952c396a727c for instance with vm_state active and task_state deleting.
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-1684f1e7-b9c2-4228-8809-ebaae1ed41c7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-unplugged-1684f1e7-b9c2-4228-8809-ebaae1ed41c7 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-1684f1e7-b9c2-4228-8809-ebaae1ed41c7 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-1684f1e7-b9c2-4228-8809-ebaae1ed41c7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-1684f1e7-b9c2-4228-8809-ebaae1ed41c7 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:39 user nova-compute[71711]: WARNING nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-1684f1e7-b9c2-4228-8809-ebaae1ed41c7 for instance with vm_state active and task_state deleting.
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-unplugged-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:39 user nova-compute[71711]: WARNING nova.compute.manager [req-0640cc02-746b-4f68-89c4-4a45e52ce227 req-ac7c3e06-9aa1-4d4f-81b5-c2196e007460 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb for instance with vm_state active and task_state deleting.
Apr 12 06:24:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:39 user nova-compute[71711]: INFO os_vif [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=22b7b070-9ef1-402f-8cbc-50684b0dad1c,network=Network(4dc59fb9-a627-448d-a42b-937b5d2e5b00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b7b070-9e')
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PptcCjqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:39 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d55442-e96c-4893-80bf-7180c5d9a936]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:24:39 user nova-compute[71711]: No targets found.
Apr 12 06:24:39 user nova-compute[71711]: iSNS:
Apr 12 06:24:39 user nova-compute[71711]: No targets found.
Apr 12 06:24:39 user nova-compute[71711]: STATIC:
Apr 12 06:24:39 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5
Apr 12 06:24:39 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:39 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:39 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:24:39 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:39 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:39 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3
Apr 12 06:24:39 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:39 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:39 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901
Apr 12 06:24:39 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:39 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:39 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:24:39 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:39 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:39 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29
Apr 12 06:24:39 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:39 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:39 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6
Apr 12 06:24:39 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:39 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:39 user nova-compute[71711]: FIRMWARE:
Apr 12 06:24:39 user nova-compute[71711]: No targets found.
Apr 12 06:24:39 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:24:39 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:24:39 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3b869d-eb0b-4902-8543-05347a3f99b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 915406848 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d190fa21-a433-49a2-9a0e-bcb7b0af2fc7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:39 user nova-compute[71711]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:39 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:39 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:39 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:39 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:39 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:39 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:39 user nova-compute[71711]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:39 user nova-compute[71711]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 (non-flash)
Apr 12 06:24:39 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:39 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:39 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:39 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:39 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c1bb760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29'): ({'sdb'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Removing single pathed devices sdb {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2ed9a4-5302-4138-a8e8-d3bda78c1de1]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5f35f7-7e4a-4fd8-8146-5b1da46a60b0]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Flushing IO for device /dev/sdb {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-554da142-b142-489e-9f13-97d75b4575d9 req-4fa08fdc-c2e7-4615-978e-0f8c5c932298 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-554da142-b142-489e-9f13-97d75b4575d9 req-4fa08fdc-c2e7-4615-978e-0f8c5c932298 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-554da142-b142-489e-9f13-97d75b4575d9 req-4fa08fdc-c2e7-4615-978e-0f8c5c932298 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-554da142-b142-489e-9f13-97d75b4575d9 req-4fa08fdc-c2e7-4615-978e-0f8c5c932298 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-554da142-b142-489e-9f13-97d75b4575d9 req-4fa08fdc-c2e7-4615-978e-0f8c5c932298 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:39 user nova-compute[71711]: WARNING nova.compute.manager [req-554da142-b142-489e-9f13-97d75b4575d9 req-4fa08fdc-c2e7-4615-978e-0f8c5c932298 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-55fc6a3a-a62f-406f-9583-f4168544b133 for instance with vm_state active and task_state deleting.
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[832307ac-ef89-49ea-8383-47f04e43bfde]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:24:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.066s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[058a6309-72b5-476a-8b2f-b0f146501bca]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da105f-1f2d-457d-b465-ca75a696c51d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d8c2fd-a758-486a-bdd4-0a91bd61043f]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260]
Apr 12 06:24:40 user nova-compute[71711]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6938de6c-91d6-44b2-af51-33e34e241f29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5c709d-55bc-4096-a9b5-d0fe33210069]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.453s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] <== disconnect_volume: return (455ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjSIiUbK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:40 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e54c6e1-789c-49e0-972b-500409e6fb02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:24:40 user nova-compute[71711]: No targets found.
Apr 12 06:24:40 user nova-compute[71711]: iSNS:
Apr 12 06:24:40 user nova-compute[71711]: No targets found.
Apr 12 06:24:40 user nova-compute[71711]: STATIC:
Apr 12 06:24:40 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5
Apr 12 06:24:40 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:40 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:40 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:24:40 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:40 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:40 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3
Apr 12 06:24:40 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:40 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:40 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901
Apr 12 06:24:40 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:40 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:40 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:24:40 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:40 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:40 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6
Apr 12 06:24:40 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:40 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:40 user nova-compute[71711]: FIRMWARE:
Apr 12 06:24:40 user nova-compute[71711]: No targets found.
Apr 12 06:24:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:24:40 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:24:40 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b4599a-1b71-45ce-83dd-bc597128b05f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a1e2d5-af3d-4343-be9f-217851b8893a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c1bb760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3'): ({'sdc'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Removing single pathed devices sdc {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 1054867456 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaa1b79-a358-4297-842e-49dc1f36c0a0]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[725e5998-ebd7-40fc-bc86-3f8571e738ff]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Flushing IO for device /dev/sdc {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d8d354-51f9-40c9-b679-797dd91d0e96]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ee1bf0-c2cb-4192-b505-4ec0acfc9677]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-f984771f-43c1-4565-8e7f-34d142b19801 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-f984771f-43c1-4565-8e7f-34d142b19801 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:40 user nova-compute[71711]: WARNING nova.compute.manager [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-f984771f-43c1-4565-8e7f-34d142b19801 for instance with vm_state active and task_state deleting.
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-6ee43811-1303-4a84-8bd4-0de882daac34 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-unplugged-6ee43811-1303-4a84-8bd4-0de882daac34 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-6ee43811-1303-4a84-8bd4-0de882daac34 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-6ee43811-1303-4a84-8bd4-0de882daac34 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-6ee43811-1303-4a84-8bd4-0de882daac34 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:40 user nova-compute[71711]: WARNING nova.compute.manager [req-4b487dba-f2c6-47ab-af44-59899e70c5f8 req-160c797e-fe90-4b2e-b1dc-fc0e7d527a37 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-6ee43811-1303-4a84-8bd4-0de882daac34 for instance with vm_state active and task_state deleting.
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9aee81-80a7-4384-b6f5-ae49b132eb62]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f6cdf6-1789-4edb-9190-e6fa19e32dbf]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3, portal: 172.16.0.220,3260]
Apr 12 06:24:40 user nova-compute[71711]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1bda7d-311d-45ff-9270-f1f4126818f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa25885-5011-43f9-be8f-a18d53091224]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] <== disconnect_volume: return (363ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdTKAgwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:40 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc482879-9e38-4949-8d91-8bd1d8d7d971]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:24:40 user nova-compute[71711]: No targets found.
Apr 12 06:24:40 user nova-compute[71711]: iSNS:
Apr 12 06:24:40 user nova-compute[71711]: No targets found.
Apr 12 06:24:40 user nova-compute[71711]: STATIC:
Apr 12 06:24:40 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5
Apr 12 06:24:40 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:40 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:40 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:24:40 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:40 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:40 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901
Apr 12 06:24:40 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:40 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:40 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:24:40 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:40 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:40 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6
Apr 12 06:24:40 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:40 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:40 user nova-compute[71711]: FIRMWARE:
Apr 12 06:24:40 user nova-compute[71711]: No targets found.
Apr 12 06:24:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:24:40 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:24:40 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[395189ec-c32a-470c-b76a-26390261b664]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3780e4f-ad5f-4dfd-a0dd-4bb3bcee159f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:40 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c6b4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6'): ({'sdd'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Removing single pathed devices sdd {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e99eac-d6da-4246-801e-796434fab67b]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f387e28-3366-462a-95e6-0f810d882595]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Flushing IO for device /dev/sdd {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c949da-77b5-4286-927a-f07048f9829a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dff349-b465-44dc-a5ef-54c35b2e4399]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cf7acc-da03-493d-8a3b-41d0b36e8aae]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e7f5ad-a0a8-4d86-bde3-12ab72cb689c]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6, portal: 172.16.0.220,3260]
Apr 12 06:24:40 user nova-compute[71711]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19059339-d01d-43bc-9939-181649d28bc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ae1db0-9dfe-4572-b5fc-086b0454c7ff]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] <== disconnect_volume: return (297ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:24:40 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Deleting instance files /opt/stack/data/nova/instances/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b_del
Apr 12 06:24:40 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Deletion of /opt/stack/data/nova/instances/7133ac6b-6627-4aaa-86f9-9ac3c8f8139b_del complete
Apr 12 06:24:40 user nova-compute[71711]: INFO nova.compute.manager [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Took 3.90 seconds to destroy the instance on the hypervisor.
Apr 12 06:24:40 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:24:40 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYNAnVgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'a0819b26-7af7-426a-8242-84954c0851f5': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:41 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba81c3b-3a17-4b66-9e17-c629a0d1ee9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:24:41 user nova-compute[71711]: No targets found.
Apr 12 06:24:41 user nova-compute[71711]: iSNS:
Apr 12 06:24:41 user nova-compute[71711]: No targets found.
Apr 12 06:24:41 user nova-compute[71711]: STATIC:
Apr 12 06:24:41 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5
Apr 12 06:24:41 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:41 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:41 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:24:41 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:41 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:41 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901
Apr 12 06:24:41 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:41 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:41 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:24:41 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:41 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:41 user nova-compute[71711]: FIRMWARE:
Apr 12 06:24:41 user nova-compute[71711]: No targets found.
Apr 12 06:24:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:24:41 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:24:41 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a92f06c-4cf5-4a90-87f7-d192bd1cc3ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767320c-fdff-421f-b94d-b426b1fe4a50]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:41 user nova-compute[71711]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:41 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:41 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 (non-flash)
Apr 12 06:24:41 user nova-compute[71711]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:41 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:41 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c1bb7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5'): ({'sdf'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Removing single pathed devices sdf {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb59f1f-99a1-4cc7-9354-8da3a62226ae]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f7b7ac-fc1d-409f-a07c-941bb42545c5]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Flushing IO for device /dev/sdf {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a14306a-fa10-4be8-9312-7c92b2ac4da1]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7c8f8e-b814-4474-8fc2-7f830b410003]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1ccf4e-3806-40ce-8824-110b6c065d2f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[946ddf0f-3c6d-48b1-b127-668860f82098]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5, portal: 172.16.0.220,3260]
Apr 12 06:24:41 user nova-compute[71711]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0819b26-7af7-426a-8242-84954c0851f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[705255fb-c104-4345-88c8-2e5b18b584ae]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] <== disconnect_volume: return (325ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXLxNfBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '33458552-cb23-41c7-9cb7-ef13301468f6', 'attached_at': '', 'detached_at': '', 'volume_id': '1872667c-83a2-4de7-a347-cc3fd70bf901', 'serial'} {{(pid=71711) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] swap_volume: removing Cinder connection for volume a0819b26-7af7-426a-8242-84954c0851f5 {{(pid=71711) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvpZhPcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:41 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:41 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:41 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0a5130-9f25-4cad-a49c-d6af2bf111c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:24:41 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56baae9-6eda-43e2-b1fb-d9e4e57e9caf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881] added
Apr 12 06:24:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[87513ec3-1a43-4b8b-8778-4b6f3eaa7cad]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[51da2b62-129b-4912-8319-09cbda44a8a2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zvpZhPcJ {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zvpZhPcJ" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35c6705-d0f0-44dc-b170-9e7e6488d3a1]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zvpZhPcJ'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45e1fd0-1bea-40cc-aed9-3934cd61f510]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4216e5-a1fd-437a-91fa-42413528a09a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:41 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:41 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:41 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:41 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-22b7b070-9ef1-402f-8cbc-50684b0dad1c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-unplugged-22b7b070-9ef1-402f-8cbc-50684b0dad1c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-unplugged-22b7b070-9ef1-402f-8cbc-50684b0dad1c for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-plugged-22b7b070-9ef1-402f-8cbc-50684b0dad1c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] Acquiring lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] No waiting events found dispatching network-vif-plugged-22b7b070-9ef1-402f-8cbc-50684b0dad1c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:41 user nova-compute[71711]: WARNING nova.compute.manager [req-65a820cc-c10c-4c5e-8670-23f811f949ec req-90a7e7d8-4883-4a30-aaea-28e4865ea497 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received unexpected event network-vif-plugged-22b7b070-9ef1-402f-8cbc-50684b0dad1c for instance with vm_state active and task_state deleting.
Apr 12 06:24:42 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] swap_volume: Updating volume a0819b26-7af7-426a-8242-84954c0851f5 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "HXLxNfBv", "auth_password": "axhoiYcwrNkFD1", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "1872667c-83a2-4de7-a347-cc3fd70bf901"}, "status": "reserved", "instance": "33458552-cb23-41c7-9cb7-ef13301468f6", "attached_at": "", "detached_at": "", "volume_id": "1872667c-83a2-4de7-a347-cc3fd70bf901", "serial": "1872667c-83a2-4de7-a347-cc3fd70bf901"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '1872667c-83a2-4de7-a347-cc3fd70bf901', 'no_device': None, 'attachment_id': '9146e0f6-f10b-4b14-83c6-bbd8b649a807'} {{(pid=71711) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3aaad2c5-4254-4054-807b-446ec3d6a4bf tempest-TestVolumeSwap-1770819984 tempest-TestVolumeSwap-1770819984-project-admin] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.838s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --login" returned: 0 in 1.062s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c839f38b-1dbe-406e-8f02-25ad11122cb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881, portal: 172.16.0.220,3260]
Apr 12 06:24:42 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba45067-a2bf-4981-9624-5de7cdb53dc5]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe97754-d31a-4d4c-a730-e87057497de5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:42 user nova-compute[71711]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 (non-flash)
Apr 12 06:24:42 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:42 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:42 user nova-compute[71711]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 (non-flash)
Apr 12 06:24:42 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:42 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.290s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb358fe-d484-4f5e-9161-bec4c78a9789]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvpZhPcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:24:42 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "33458552-cb23-41c7-9cb7-ef13301468f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:43 user nova-compute[71711]: INFO nova.compute.manager [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Detaching volume 1872667c-83a2-4de7-a347-cc3fd70bf901
Apr 12 06:24:43 user nova-compute[71711]: INFO nova.virt.block_device [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Attempting to driver detach volume 1872667c-83a2-4de7-a347-cc3fd70bf901 from mountpoint /dev/vdb
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Attempting to detach device vdb from instance 33458552-cb23-41c7-9cb7-ef13301468f6 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:24:43 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:24:43 user nova-compute[71711]:   <source dev="/dev/sdh"/>
Apr 12 06:24:43 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:24:43 user nova-compute[71711]:   <serial>1872667c-83a2-4de7-a347-cc3fd70bf901</serial>
Apr 12 06:24:43 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:24:43 user nova-compute[71711]: </disk>
Apr 12 06:24:43 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:24:43 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Successfully detached device vdb from instance 33458552-cb23-41c7-9cb7-ef13301468f6 from the persistent domain config.
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33458552-cb23-41c7-9cb7-ef13301468f6 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:24:43 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:24:43 user nova-compute[71711]:   <source dev="/dev/sdh"/>
Apr 12 06:24:43 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:24:43 user nova-compute[71711]:   <serial>1872667c-83a2-4de7-a347-cc3fd70bf901</serial>
Apr 12 06:24:43 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:24:43 user nova-compute[71711]: </disk>
Apr 12 06:24:43 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating instance_info_cache with network_info: [{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-e7675c7d-1d5d-45f5-a2b9-52d86ac2712e req-21aae55c-cc06-4d33-9b21-2c2bd85ff8b7 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-deleted-55fc6a3a-a62f-406f-9583-f4168544b133 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:43 user nova-compute[71711]: INFO nova.compute.manager [req-e7675c7d-1d5d-45f5-a2b9-52d86ac2712e req-21aae55c-cc06-4d33-9b21-2c2bd85ff8b7 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Neutron deleted interface 55fc6a3a-a62f-406f-9583-f4168544b133; detaching it from the instance and deleting it from the info cache
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.network.neutron [req-e7675c7d-1d5d-45f5-a2b9-52d86ac2712e req-21aae55c-cc06-4d33-9b21-2c2bd85ff8b7 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating instance_info_cache with network_info: [{"id": "48b06cf1-3d27-423d-a0fb-952c396a727c", "address": "fa:16:3e:e5:98:cb", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48b06cf1-3d", "ovs_interfaceid": "48b06cf1-3d27-423d-a0fb-952c396a727c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "address": "fa:16:3e:13:66:36", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1684f1e7-b9", "ovs_interfaceid": "1684f1e7-b9c2-4228-8809-ebaae1ed41c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f984771f-43c1-4565-8e7f-34d142b19801", "address": "fa:16:3e:cf:c5:ab", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf984771f-43", "ovs_interfaceid": "f984771f-43c1-4565-8e7f-34d142b19801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ee43811-1303-4a84-8bd4-0de882daac34", "address": "fa:16:3e:37:23:e2", "network": {"id": "c6cbc36d-525c-462c-b4c5-ee40eb7eb5b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-138190247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ee43811-13", "ovs_interfaceid": "6ee43811-1303-4a84-8bd4-0de882daac34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "address": "fa:16:3e:e5:63:8c", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1585d729-d8", "ovs_interfaceid": "1585d729-d8e7-44e3-b0d6-2367ec0fb1cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "address": "fa:16:3e:0b:4f:d7", "network": {"id": "4dc59fb9-a627-448d-a42b-937b5d2e5b00", "bridge": "br-int", "label": "tempest-device-tagging-net2-846216562", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e313922ba234462285d20a4f1f2d88d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b7b070-9e", "ovs_interfaceid": "22b7b070-9ef1-402f-8cbc-50684b0dad1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-e7675c7d-1d5d-45f5-a2b9-52d86ac2712e req-21aae55c-cc06-4d33-9b21-2c2bd85ff8b7 service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Detach interface failed, port_id=55fc6a3a-a62f-406f-9583-f4168544b133, reason: Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b could not be found. {{(pid=71711) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681280683.5757747, 33458552-cb23-41c7-9cb7-ef13301468f6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33458552-cb23-41c7-9cb7-ef13301468f6 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:24:43 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Successfully detached device vdb from instance 33458552-cb23-41c7-9cb7-ef13301468f6 from the live domain config.
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HXLxNfBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '1872667c-83a2-4de7-a347-cc3fd70bf901': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:43 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.326s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] <== connect_volume: return (2327ms) {'type': 'block', 'scsi_wwn': '26262343537313665', 'path': '/dev/sdb'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262343537313665', 'path': '/dev/sdb'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.150s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.objects.instance [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'flavor' on Instance uuid a528e600-7358-4b92-9b71-12759f405b38 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd160e2e-72a5-4313-a235-0ca67ed2a958]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:24:43 user nova-compute[71711]: No targets found.
Apr 12 06:24:43 user nova-compute[71711]: iSNS:
Apr 12 06:24:43 user nova-compute[71711]: No targets found.
Apr 12 06:24:43 user nova-compute[71711]: STATIC:
Apr 12 06:24:43 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881
Apr 12 06:24:43 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:43 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:43 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:24:43 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:43 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:43 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901
Apr 12 06:24:43 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:43 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:43 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:24:43 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:43 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:43 user nova-compute[71711]: FIRMWARE:
Apr 12 06:24:43 user nova-compute[71711]: No targets found.
Apr 12 06:24:43 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:24:43 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:24:43 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:24:43 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:24:43 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:24:43 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:24:43 user nova-compute[71711]:   <serial>7b336ad6-910c-4dd4-8ef4-c16d440e9881</serial>
Apr 12 06:24:43 user nova-compute[71711]: </disk>
Apr 12 06:24:43 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c7dbe1-9427-4d6f-9da2-83cb971ddf7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e674d8c-ce14-44e7-9f56-b6c584097650]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:43 user nova-compute[71711]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 (non-flash)
Apr 12 06:24:43 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:43 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:43 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 (non-flash)
Apr 12 06:24:43 user nova-compute[71711]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 (non-flash)
Apr 12 06:24:43 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:43 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:43 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c4e4670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901'): ({'sdh'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Removing single pathed devices sdh {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3029ca-7319-4b0a-a971-6089dafea68b]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[649a8238-3b0f-4e8f-9ccb-b7408ee16cf5]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Flushing IO for device /dev/sdh {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ad64a2-b464-4c40-b6f9-df2f433bfa2a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6b2f82-b150-4674-a09f-e1e0bbe698c3]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] SCSI volumes sdh have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c56404f-6908-4b19-89fb-0a58286e021f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[73590b01-0a1f-4faa-a772-2ebb3be07905]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260]
Apr 12 06:24:44 user nova-compute[71711]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:44 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1872667c-83a2-4de7-a347-cc3fd70bf901 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8183dc-20b4-48b7-a506-4be3d15fc562]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] <== disconnect_volume: return (508ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] No VIF found with MAC fa:16:3e:d6:d7:ba, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-918cfc24-30a6-48a9-af17-37fdf86e8e21 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "a528e600-7358-4b92-9b71-12759f405b38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.086s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG nova.objects.instance [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lazy-loading 'flavor' on Instance uuid 33458552-cb23-41c7-9cb7-ef13301468f6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-68cb0728-cd8b-4127-8ba1-120ce51e46e2 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.047s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:45 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Took 4.37 seconds to deallocate network for instance.
Apr 12 06:24:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG nova.compute.manager [req-dbbc949d-6311-4635-9ac3-c59020a7d07f req-a5c0517d-650f-4241-85c1-35eb5946da2e service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-deleted-22b7b070-9ef1-402f-8cbc-50684b0dad1c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG nova.compute.manager [req-dbbc949d-6311-4635-9ac3-c59020a7d07f req-a5c0517d-650f-4241-85c1-35eb5946da2e service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-deleted-1585d729-d8e7-44e3-b0d6-2367ec0fb1cb {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG nova.compute.manager [req-dbbc949d-6311-4635-9ac3-c59020a7d07f req-a5c0517d-650f-4241-85c1-35eb5946da2e service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-deleted-f984771f-43c1-4565-8e7f-34d142b19801 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG nova.compute.manager [req-dbbc949d-6311-4635-9ac3-c59020a7d07f req-a5c0517d-650f-4241-85c1-35eb5946da2e service nova] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Received event network-vif-deleted-6ee43811-1303-4a84-8bd4-0de882daac34 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "a528e600-7358-4b92-9b71-12759f405b38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "a528e600-7358-4b92-9b71-12759f405b38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:46 user nova-compute[71711]: INFO nova.compute.manager [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Detaching volume 7b336ad6-910c-4dd4-8ef4-c16d440e9881
Apr 12 06:24:46 user nova-compute[71711]: INFO nova.virt.block_device [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Attempting to driver detach volume 7b336ad6-910c-4dd4-8ef4-c16d440e9881 from mountpoint /dev/vdb
Apr 12 06:24:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Attempting to detach device vdb from instance a528e600-7358-4b92-9b71-12759f405b38 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:24:46 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:24:46 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:24:46 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:24:46 user nova-compute[71711]:   <serial>7b336ad6-910c-4dd4-8ef4-c16d440e9881</serial>
Apr 12 06:24:46 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:24:46 user nova-compute[71711]: </disk>
Apr 12 06:24:46 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:24:46 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Successfully detached device vdb from instance a528e600-7358-4b92-9b71-12759f405b38 from the persistent domain config.
Apr 12 06:24:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a528e600-7358-4b92-9b71-12759f405b38 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:24:46 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:24:46 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:24:46 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:24:46 user nova-compute[71711]:   <serial>7b336ad6-910c-4dd4-8ef4-c16d440e9881</serial>
Apr 12 06:24:46 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:24:46 user nova-compute[71711]: </disk>
Apr 12 06:24:46 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681280686.960204, a528e600-7358-4b92-9b71-12759f405b38 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a528e600-7358-4b92-9b71-12759f405b38 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:24:47 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Successfully detached device vdb from instance a528e600-7358-4b92-9b71-12759f405b38 from the live domain config.
Apr 12 06:24:47 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:24:47 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8037MB free_disk=26.491554260253906GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvpZhPcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:47 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[980e5e2b-6549-482d-8aaa-5bc6a27662bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:24:47 user nova-compute[71711]: No targets found.
Apr 12 06:24:47 user nova-compute[71711]: iSNS:
Apr 12 06:24:47 user nova-compute[71711]: No targets found.
Apr 12 06:24:47 user nova-compute[71711]: STATIC:
Apr 12 06:24:47 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881
Apr 12 06:24:47 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:47 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:47 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:24:47 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:47 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:47 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:24:47 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:47 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:47 user nova-compute[71711]: FIRMWARE:
Apr 12 06:24:47 user nova-compute[71711]: No targets found.
Apr 12 06:24:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:24:47 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:24:47 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[67187866-50b4-4c2b-b459-d33e99938a74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf675101-f485-4129-b255-89af51492d03]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 (non-flash)
Apr 12 06:24:47 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:47 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 (non-flash)
Apr 12 06:24:47 user nova-compute[71711]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:47 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c68d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881'): ({'sdb'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Removing single pathed devices sdb {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e783c7-15e4-4e38-af45-2d1f4ae704a1]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7dee97a4-9497-43c2-a688-7bedd1441885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 1c02afd2-428b-49c9-a5e9-016fdeab1046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 33458552-cb23-41c7-9cb7-ef13301468f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance a528e600-7358-4b92-9b71-12759f405b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 2a24ff32-6994-4754-be34-7664bbe21d16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1916ef8a-5ebc-468f-bce7-f94912dc6f8a]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Flushing IO for device /dev/sdb {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1475a9a2-e539-4553-9bda-7a8de1adc8dd]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da32ceb-e38c-494e-8440-41f22910dfc3]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc7bd56-532b-4b40-bd38-b6dac0ceb2d5]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d69875b-1e6b-4fa9-bfac-2765501c5697]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881, portal: 172.16.0.220,3260]
Apr 12 06:24:47 user nova-compute[71711]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b336ad6-910c-4dd4-8ef4-c16d440e9881 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[553d9abe-9242-47d1-9084-c85c55850dd7]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] <== disconnect_volume: return (330ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:24:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:48 user nova-compute[71711]: INFO nova.compute.manager [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Took 2.81 seconds to detach 3 volumes for instance.
Apr 12 06:24:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:48 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:24:48 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:24:48 user nova-compute[71711]: DEBUG nova.objects.instance [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'flavor' on Instance uuid a528e600-7358-4b92-9b71-12759f405b38 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8f9eb028-1ce9-429c-8d93-c9f0a592e915 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "a528e600-7358-4b92-9b71-12759f405b38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.163s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:48 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Deleted allocations for instance 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b
Apr 12 06:24:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-051dbca6-f4f8-4890-8481-44ef8788e05e tempest-TaggedBootDevicesTest_v242-1197354508 tempest-TaggedBootDevicesTest_v242-1197354508-project-member] Lock "7133ac6b-6627-4aaa-86f9-9ac3c8f8139b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.595s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:52 user nova-compute[71711]: DEBUG nova.compute.manager [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-changed-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:52 user nova-compute[71711]: DEBUG nova.compute.manager [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Refreshing instance network info cache due to event network-changed-f2b23249-b032-47f5-973e-922f210b40b2. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:24:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] Acquiring lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:24:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] Acquired lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:24:52 user nova-compute[71711]: DEBUG nova.network.neutron [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Refreshing network info cache for port f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:24:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:53 user nova-compute[71711]: INFO nova.compute.manager [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Shelve offloading
Apr 12 06:24:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:53 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280678.8944502, 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:24:53 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] VM Stopped (Lifecycle Event)
Apr 12 06:24:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-49f33a3c-3423-45ad-944f-4e7c1378df17 None None] [instance: 7133ac6b-6627-4aaa-86f9-9ac3c8f8139b] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:24:53 user nova-compute[71711]: DEBUG nova.network.neutron [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updated VIF entry in instance network info cache for port f2b23249-b032-47f5-973e-922f210b40b2. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:24:53 user nova-compute[71711]: DEBUG nova.network.neutron [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updating instance_info_cache with network_info: [{"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9b623212-a729-4c9a-a274-33980a112dfa req-604cb438-4333-4d27-ae1b-dde8fe1187ef service nova] Releasing lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:24:54 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Instance destroyed successfully.
Apr 12 06:24:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:24:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:24:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquired lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:24:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:24:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-vif-unplugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] No waiting events found dispatching network-vif-unplugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:55 user nova-compute[71711]: WARNING nova.compute.manager [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received unexpected event network-vif-unplugged-f2b23249-b032-47f5-973e-922f210b40b2 for instance with vm_state active and task_state shelving.
Apr 12 06:24:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] No waiting events found dispatching network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:24:55 user nova-compute[71711]: WARNING nova.compute.manager [req-5c352917-73b7-4a9f-9371-74ef01773301 req-368c2964-83d4-479b-bf85-7450e6f491a9 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received unexpected event network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 for instance with vm_state active and task_state shelving.
Apr 12 06:24:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updating instance_info_cache with network_info: [{"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Releasing lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:56 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Instance destroyed successfully.
Apr 12 06:24:56 user nova-compute[71711]: DEBUG nova.objects.instance [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lazy-loading 'resources' on Instance uuid 7141c80d-34a9-40cc-a792-b01ffd9155b6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:23:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1182120878',display_name='tempest-TestShelveInstance-server-1182120878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1182120878',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/XYJS5WZMk53chHKmw/+iSEEOXZF7wP3pIbC0AGTht+XIXJedtGoPTQqkFu+XBL60BEsYozXDU+97steer9vl1moNpsewzRRDuc/MQvBwxKIIaehE8Onlx0BWl81dCFA==',key_name='tempest-TestShelveInstance-1634672150',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7742afa38eb46818efaf3b811c417ba',ramdisk_id='',reservation_id='r-jkmurz28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-735091148',owner_user_name='tempest-TestShelveInstance-735091148-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:23:15Z,user_data=None,user_id='9ed3a446901644b6a622afb3166f08dc',uuid=7141c80d-34a9-40cc-a792-b01ffd9155b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Converting VIF {"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_vif [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2b23249-b0, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-changed-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Refreshing instance network info cache due to event network-changed-f2b23249-b032-47f5-973e-922f210b40b2. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] Acquiring lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] Acquired lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG nova.network.neutron [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Refreshing network info cache for port f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:24:56 user nova-compute[71711]: INFO os_vif [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0')
Apr 12 06:24:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcOxDrPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:24:56 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[82011e54-3ccf-44d8-a2b5-19c50806dff9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:24:56 user nova-compute[71711]: No targets found.
Apr 12 06:24:56 user nova-compute[71711]: iSNS:
Apr 12 06:24:56 user nova-compute[71711]: No targets found.
Apr 12 06:24:56 user nova-compute[71711]: STATIC:
Apr 12 06:24:56 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:24:56 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:56 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:56 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:24:56 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:24:56 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:24:56 user nova-compute[71711]: FIRMWARE:
Apr 12 06:24:56 user nova-compute[71711]: No targets found.
Apr 12 06:24:56 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:24:56 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:24:56 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad8629c-821f-46c8-8429-db62e5ec4ccc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[537b3406-aaab-4700-8f8a-01bc08ca1d3d]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:56 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:56 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:24:56 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:24:56 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9961e413f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a'): ({'sde'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Removing single pathed devices sde {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e1c711-521c-4921-b451-6193ba9d385d]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa1bc61-b6dd-483a-87aa-89c6986be8a9]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Flushing IO for device /dev/sde {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4070b40a-7c7d-4f21-9605-8635ca80ed95]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b261ecea-2631-4a3f-9949-c6370cea729f]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] SCSI volumes sde have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f081e1d-77ad-4f74-9d4b-31bf90e551df]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f172e518-6657-429c-b5bf-ccece6ff9bc6]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260]
Apr 12 06:24:56 user nova-compute[71711]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260] successful.
Apr 12 06:24:56 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad273f2c-1a7a-4317-9c19-f2187d29802d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] <== disconnect_volume: return (315ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:24:56 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Deleting instance files /opt/stack/data/nova/instances/7141c80d-34a9-40cc-a792-b01ffd9155b6_del
Apr 12 06:24:56 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Deletion of /opt/stack/data/nova/instances/7141c80d-34a9-40cc-a792-b01ffd9155b6_del complete
Apr 12 06:24:56 user nova-compute[71711]: DEBUG nova.network.neutron [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updated VIF entry in instance network info cache for port f2b23249-b032-47f5-973e-922f210b40b2. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG nova.network.neutron [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updating instance_info_cache with network_info: [{"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": null, "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf2b23249-b0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:24:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d694d37d-dd00-4785-893a-fa3923a51b4f req-c7dd83bb-7c05-4123-9872-9e1a3580ecf3 service nova] Releasing lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:24:57 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Deleted allocations for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6
Apr 12 06:24:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:24:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:24:57 user nova-compute[71711]: DEBUG nova.objects.instance [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lazy-loading 'numa_topology' on Instance uuid 7141c80d-34a9-40cc-a792-b01ffd9155b6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:24:58 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:24:58 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:24:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-15ece6bd-f56e-4507-ad84-8b4720aafb86 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.981s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:24:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:09 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280694.0538197, 7141c80d-34a9-40cc-a792-b01ffd9155b6 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:25:09 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] VM Stopped (Lifecycle Event)
Apr 12 06:25:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a2da69ea-ad52-4773-8c8e-b7a6e133bb69 None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:10 user nova-compute[71711]: INFO nova.compute.manager [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Terminating instance
Apr 12 06:25:10 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-d487a33b-2251-40ca-a564-6d01631cdb78 req-6d54236b-5fbe-4000-979f-d3debc7adaa0 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-vif-unplugged-e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d487a33b-2251-40ca-a564-6d01631cdb78 req-6d54236b-5fbe-4000-979f-d3debc7adaa0 service nova] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d487a33b-2251-40ca-a564-6d01631cdb78 req-6d54236b-5fbe-4000-979f-d3debc7adaa0 service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d487a33b-2251-40ca-a564-6d01631cdb78 req-6d54236b-5fbe-4000-979f-d3debc7adaa0 service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-d487a33b-2251-40ca-a564-6d01631cdb78 req-6d54236b-5fbe-4000-979f-d3debc7adaa0 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] No waiting events found dispatching network-vif-unplugged-e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-d487a33b-2251-40ca-a564-6d01631cdb78 req-6d54236b-5fbe-4000-979f-d3debc7adaa0 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-vif-unplugged-e215c62b-ca21-474c-bb78-e65c3d3a6d23 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:25:10 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Instance destroyed successfully.
Apr 12 06:25:10 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lazy-loading 'resources' on Instance uuid 1c02afd2-428b-49c9-a5e9-016fdeab1046 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-535299913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-535299913',id=6,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsYFbAoV+s8XfUdzNJguOlyjgf5rzssGClNchETA1Wb0ZBXMDpVCtnjv4m62tZx7TC11beScEz0QICYslGhXYxCCYoznL60xxNw9+KIk2H3I9oh00SIE1sHei3bsDqqwQ==',key_name='tempest-keypair-1020989553',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96d2a1b102d54e8194741137e193436f',ramdisk_id='',reservation_id='r-0ngl4bz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1179204824',owner_user_name='tempest-TaggedAttachmentsTest-1179204824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:22:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='896e1c5d0edd4a1d9d122115f02dfef7',uuid=1c02afd2-428b-49c9-a5e9-016fdeab1046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converting VIF {"id": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "address": "fa:16:3e:fb:fb:33", "network": {"id": "00422635-29f9-424b-99fd-93e32fe08520", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1127193480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d2a1b102d54e8194741137e193436f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape215c62b-ca", "ovs_interfaceid": "e215c62b-ca21-474c-bb78-e65c3d3a6d23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:fb:33,bridge_name='br-int',has_traffic_filtering=True,id=e215c62b-ca21-474c-bb78-e65c3d3a6d23,network=Network(00422635-29f9-424b-99fd-93e32fe08520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape215c62b-ca') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG os_vif [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:fb:33,bridge_name='br-int',has_traffic_filtering=True,id=e215c62b-ca21-474c-bb78-e65c3d3a6d23,network=Network(00422635-29f9-424b-99fd-93e32fe08520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape215c62b-ca') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape215c62b-ca, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:10 user nova-compute[71711]: INFO os_vif [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:fb:33,bridge_name='br-int',has_traffic_filtering=True,id=e215c62b-ca21-474c-bb78-e65c3d3a6d23,network=Network(00422635-29f9-424b-99fd-93e32fe08520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape215c62b-ca')
Apr 12 06:25:10 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Deleting instance files /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046_del
Apr 12 06:25:10 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Deletion of /opt/stack/data/nova/instances/1c02afd2-428b-49c9-a5e9-016fdeab1046_del complete
Apr 12 06:25:10 user nova-compute[71711]: INFO nova.compute.manager [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 06:25:10 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:25:10 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:25:11 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:11 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Took 0.68 seconds to deallocate network for instance.
Apr 12 06:25:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:11 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:25:11 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:25:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:11 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Deleted allocations for instance 1c02afd2-428b-49c9-a5e9-016fdeab1046
Apr 12 06:25:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a4ca0b22-4137-4d2c-817e-d479d6283dd3 tempest-TaggedAttachmentsTest-1179204824 tempest-TaggedAttachmentsTest-1179204824-project-member] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.013s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-vif-plugged-e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] Acquiring lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] Lock "1c02afd2-428b-49c9-a5e9-016fdeab1046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] No waiting events found dispatching network-vif-plugged-e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:12 user nova-compute[71711]: WARNING nova.compute.manager [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received unexpected event network-vif-plugged-e215c62b-ca21-474c-bb78-e65c3d3a6d23 for instance with vm_state deleted and task_state None.
Apr 12 06:25:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3f9b564-2f51-4bc4-a4be-75ae224da937 req-71ade21d-3413-473b-834e-4bdf4d0da929 service nova] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Received event network-vif-deleted-e215c62b-ca21-474c-bb78-e65c3d3a6d23 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "d15be760-180e-4335-b670-ecd8873609b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:25:18 user nova-compute[71711]: INFO nova.compute.claims [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Claim successful on node user
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "2a24ff32-6994-4754-be34-7664bbe21d16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "2a24ff32-6994-4754-be34-7664bbe21d16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:18 user nova-compute[71711]: INFO nova.compute.manager [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Terminating instance
Apr 12 06:25:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:25:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:25:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-87495f81-76f9-43b8-bfd6-7dc69fff09e0 req-5a7b3149-d7b7-401e-88d4-f014cd5daf05 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Received event network-vif-unplugged-de80dcd5-e1e5-485d-ab7f-e595447273da {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-87495f81-76f9-43b8-bfd6-7dc69fff09e0 req-5a7b3149-d7b7-401e-88d4-f014cd5daf05 service nova] Acquiring lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-87495f81-76f9-43b8-bfd6-7dc69fff09e0 req-5a7b3149-d7b7-401e-88d4-f014cd5daf05 service nova] Lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-87495f81-76f9-43b8-bfd6-7dc69fff09e0 req-5a7b3149-d7b7-401e-88d4-f014cd5daf05 service nova] Lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-87495f81-76f9-43b8-bfd6-7dc69fff09e0 req-5a7b3149-d7b7-401e-88d4-f014cd5daf05 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] No waiting events found dispatching network-vif-unplugged-de80dcd5-e1e5-485d-ab7f-e595447273da {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-87495f81-76f9-43b8-bfd6-7dc69fff09e0 req-5a7b3149-d7b7-401e-88d4-f014cd5daf05 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Received event network-vif-unplugged-de80dcd5-e1e5-485d-ab7f-e595447273da for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:25:18 user nova-compute[71711]: INFO nova.virt.block_device [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Booting with volume 43ddfeaf-9407-49e8-abb1-f5c9d23dab3f at /dev/vda
Apr 12 06:25:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG os_brick.utils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[be886746-f36b-432e-8880-5b8847a56e67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edd6cfe-2224-4e50-9673-64f5dc34adf0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0bf173-4de4-42c8-9cf8-cf0ce8b416fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9bd16c-8aab-4e7a-b8b7-1817de22fd2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG nova.policy [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38d195bbdaf94ac9bfdba8f76157a10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b22588bca2c46f09b19d28bcf76db06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:25:19 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:25:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c0c045-26fd-4a63-95ef-550814402d47]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG os_brick.utils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating existing volume attachment record: 2ed55170-1be1-4564-8950-0a3ec073e131 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:25:19 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Instance destroyed successfully.
Apr 12 06:25:19 user nova-compute[71711]: DEBUG nova.objects.instance [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lazy-loading 'resources' on Instance uuid 2a24ff32-6994-4754-be34-7664bbe21d16 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-696456814',display_name='tempest-ServersNegativeTestJSON-server-696456814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-696456814',id=11,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:23:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbca90b5b5fb49ca857aa4e215a99e37',ramdisk_id='',reservation_id='r-36cwghu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-815999574',owner_user_name='tempest-ServersNegativeTestJSON-815999574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:23:35Z,user_data=None,user_id='e761442395d14d7f82216e3d4174e43a',uuid=2a24ff32-6994-4754-be34-7664bbe21d16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de80dcd5-e1e5-485d-ab7f-e595447273da", "address": "fa:16:3e:a7:22:e3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde80dcd5-e1", "ovs_interfaceid": "de80dcd5-e1e5-485d-ab7f-e595447273da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Converting VIF {"id": "de80dcd5-e1e5-485d-ab7f-e595447273da", "address": "fa:16:3e:a7:22:e3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde80dcd5-e1", "ovs_interfaceid": "de80dcd5-e1e5-485d-ab7f-e595447273da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=de80dcd5-e1e5-485d-ab7f-e595447273da,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde80dcd5-e1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG os_vif [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=de80dcd5-e1e5-485d-ab7f-e595447273da,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde80dcd5-e1') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde80dcd5-e1, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:19 user nova-compute[71711]: INFO os_vif [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:e3,bridge_name='br-int',has_traffic_filtering=True,id=de80dcd5-e1e5-485d-ab7f-e595447273da,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde80dcd5-e1')
Apr 12 06:25:19 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Deleting instance files /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16_del
Apr 12 06:25:19 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Deletion of /opt/stack/data/nova/instances/2a24ff32-6994-4754-be34-7664bbe21d16_del complete
Apr 12 06:25:19 user nova-compute[71711]: INFO nova.compute.manager [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 12 06:25:19 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Successfully created port: 84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:25:19 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Took 0.51 seconds to deallocate network for instance.
Apr 12 06:25:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-a9cc5274-6179-47d6-8ef0-d2419f61b88b req-4df0e9b1-e4fa-4855-b4a1-e478070d8cce service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Received event network-vif-deleted-de80dcd5-e1e5-485d-ab7f-e595447273da {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:19 user nova-compute[71711]: INFO nova.compute.manager [req-a9cc5274-6179-47d6-8ef0-d2419f61b88b req-4df0e9b1-e4fa-4855-b4a1-e478070d8cce service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Neutron deleted interface de80dcd5-e1e5-485d-ab7f-e595447273da; detaching it from the instance and deleting it from the info cache
Apr 12 06:25:19 user nova-compute[71711]: DEBUG nova.network.neutron [req-a9cc5274-6179-47d6-8ef0-d2419f61b88b req-4df0e9b1-e4fa-4855-b4a1-e478070d8cce service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-a9cc5274-6179-47d6-8ef0-d2419f61b88b req-4df0e9b1-e4fa-4855-b4a1-e478070d8cce service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Detach interface failed, port_id=de80dcd5-e1e5-485d-ab7f-e595447273da, reason: Instance 2a24ff32-6994-4754-be34-7664bbe21d16 could not be found. {{(pid=71711) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:20 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:25:20 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:25:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:20 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Deleted allocations for instance 2a24ff32-6994-4754-be34-7664bbe21d16
Apr 12 06:25:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9bae668d-745c-4f35-aeb0-fb75c270efc4 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "2a24ff32-6994-4754-be34-7664bbe21d16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.646s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:20 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Successfully created port: 36083c4a-f152-4716-a60d-0197287d6ba1 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:25:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-47a82eae-c2c4-4be4-a33c-32ae96bef85b req-9619b2b5-7440-493c-a2ac-cfd274409a00 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Received event network-vif-plugged-de80dcd5-e1e5-485d-ab7f-e595447273da {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-47a82eae-c2c4-4be4-a33c-32ae96bef85b req-9619b2b5-7440-493c-a2ac-cfd274409a00 service nova] Acquiring lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-47a82eae-c2c4-4be4-a33c-32ae96bef85b req-9619b2b5-7440-493c-a2ac-cfd274409a00 service nova] Lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-47a82eae-c2c4-4be4-a33c-32ae96bef85b req-9619b2b5-7440-493c-a2ac-cfd274409a00 service nova] Lock "2a24ff32-6994-4754-be34-7664bbe21d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-47a82eae-c2c4-4be4-a33c-32ae96bef85b req-9619b2b5-7440-493c-a2ac-cfd274409a00 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] No waiting events found dispatching network-vif-plugged-de80dcd5-e1e5-485d-ab7f-e595447273da {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:20 user nova-compute[71711]: WARNING nova.compute.manager [req-47a82eae-c2c4-4be4-a33c-32ae96bef85b req-9619b2b5-7440-493c-a2ac-cfd274409a00 service nova] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Received unexpected event network-vif-plugged-de80dcd5-e1e5-485d-ab7f-e595447273da for instance with vm_state deleted and task_state None.
Apr 12 06:25:21 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Successfully created port: 22cbdfd5-3118-4729-87fb-5f9f6e4f005c {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:25:21 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Successfully created port: dce0028f-1206-43bb-96c1-d3cbd8f57103 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:25:22 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Successfully created port: be8e308b-ba21-4e98-95bf-af2ae6446d20 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Successfully updated port: 84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-changed-84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing instance network info cache due to event network-changed-84ce2803-724b-484e-8673-6959fd03fdc9. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] Acquiring lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] Acquired lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG nova.network.neutron [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing network info cache for port 84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:25:23 user nova-compute[71711]: INFO nova.virt.block_device [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Booting with volume 8c9b01f5-884d-4f16-b344-ea6facab9090 at /dev/vdb
Apr 12 06:25:23 user nova-compute[71711]: DEBUG nova.network.neutron [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG os_brick.utils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2e7ea2-f7d7-44dc-ab67-68f23bf985eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50309df-b6fa-4bf3-aebd-f6e81b02bf56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e7ff15-617f-4b44-883c-4745969cdfbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a222cd05-e949-456a-a8e6-85aacae6324c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:25:23 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[80228d96-acd7-46a8-bf4d-1e1e970d2945]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG os_brick.utils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating existing volume attachment record: 2a42ffb3-97fa-4aad-b096-c50387e5cab7 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG nova.network.neutron [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c41ff1c3-b53d-4d0e-ae93-e6d766b0f496 req-f5b772eb-1068-465c-ade3-db15ce15c84f service nova] Releasing lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:25:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:24 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Successfully updated port: 44948ebb-503b-4166-936e-6c4101625453 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Successfully updated port: 350ec490-a274-4fe0-a88d-4d558e0d4337 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-changed-44948ebb-503b-4166-936e-6c4101625453 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing instance network info cache due to event network-changed-44948ebb-503b-4166-936e-6c4101625453. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] Acquiring lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] Acquired lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG nova.network.neutron [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing network info cache for port 44948ebb-503b-4166-936e-6c4101625453 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG nova.network.neutron [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280710.808651, 1c02afd2-428b-49c9-a5e9-016fdeab1046 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:25:25 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] VM Stopped (Lifecycle Event)
Apr 12 06:25:25 user nova-compute[71711]: DEBUG nova.compute.manager [None req-0013814b-c33a-4a43-8a32-ebf381c8e4bc None None] [instance: 1c02afd2-428b-49c9-a5e9-016fdeab1046] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG nova.network.neutron [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] Releasing lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-changed-350ec490-a274-4fe0-a88d-4d558e0d4337 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing instance network info cache due to event network-changed-350ec490-a274-4fe0-a88d-4d558e0d4337. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] Acquiring lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] Acquired lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:25:25 user nova-compute[71711]: DEBUG nova.network.neutron [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing network info cache for port 350ec490-a274-4fe0-a88d-4d558e0d4337 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:25:26 user nova-compute[71711]: DEBUG nova.network.neutron [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:25:26 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Successfully updated port: 36083c4a-f152-4716-a60d-0197287d6ba1 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:25:26 user nova-compute[71711]: DEBUG nova.network.neutron [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-631fb53d-4552-4c0a-959e-9315be7c2fd8 req-06ca14bb-00af-43a1-b014-ad8bf834b88e service nova] Releasing lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:25:27 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Successfully updated port: 22cbdfd5-3118-4729-87fb-5f9f6e4f005c {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:25:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-changed-36083c4a-f152-4716-a60d-0197287d6ba1 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing instance network info cache due to event network-changed-36083c4a-f152-4716-a60d-0197287d6ba1. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:25:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] Acquiring lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:25:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] Acquired lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:25:27 user nova-compute[71711]: DEBUG nova.network.neutron [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing network info cache for port 36083c4a-f152-4716-a60d-0197287d6ba1 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:25:27 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Successfully updated port: dce0028f-1206-43bb-96c1-d3cbd8f57103 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:25:27 user nova-compute[71711]: DEBUG nova.network.neutron [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG nova.network.neutron [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] Releasing lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-changed-22cbdfd5-3118-4729-87fb-5f9f6e4f005c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing instance network info cache due to event network-changed-22cbdfd5-3118-4729-87fb-5f9f6e4f005c. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] Acquiring lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] Acquired lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG nova.network.neutron [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing network info cache for port 22cbdfd5-3118-4729-87fb-5f9f6e4f005c {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG nova.network.neutron [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:25:28 user nova-compute[71711]: INFO nova.virt.block_device [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Booting with volume 6c75bc08-5a02-4b60-9201-616a5a4f1d88 at /dev/vdc
Apr 12 06:25:28 user nova-compute[71711]: DEBUG nova.network.neutron [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b154b8f0-9541-43b2-a19b-fa23a1ebef72 req-75bc4dd7-7195-4952-b3da-e31824b5b0dd service nova] Releasing lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Successfully updated port: be8e308b-ba21-4e98-95bf-af2ae6446d20 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG os_brick.utils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquired lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7d0003-3320-4058-8c14-6220d2188453]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee323365-81a7-40e9-bc5a-68b27528cacc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8de4330-9235-49ad-81a6-1f051057bda5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89459d3-62b8-4244-a27a-0651bf342436]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:25:28 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:25:28 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fca5c5-45fd-48d7-aa1a-8e05ac19995a]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG os_brick.utils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:25:28 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating existing volume attachment record: 5660e0e3-8e7d-473b-b61c-f8ea9e68e3a4 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:25:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-changed-dce0028f-1206-43bb-96c1-d3cbd8f57103 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing instance network info cache due to event network-changed-dce0028f-1206-43bb-96c1-d3cbd8f57103. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:25:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] Acquiring lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:25:31 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating instance_info_cache with network_info: [{"id": "84ce2803-724b-484e-8673-6959fd03fdc9", "address": "fa:16:3e:c4:ce:d4", "network": {"id": "487458d7-109b-469f-914b-1d6d01919059", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-588553343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ce2803-72", "ovs_interfaceid": "84ce2803-724b-484e-8673-6959fd03fdc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44948ebb-503b-4166-936e-6c4101625453", "address": "fa:16:3e:8e:09:1e", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44948ebb-50", "ovs_interfaceid": "44948ebb-503b-4166-936e-6c4101625453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "350ec490-a274-4fe0-a88d-4d558e0d4337", "address": "fa:16:3e:b5:ee:af", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ec490-a2", "ovs_interfaceid": "350ec490-a274-4fe0-a88d-4d558e0d4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36083c4a-f152-4716-a60d-0197287d6ba1", "address": "fa:16:3e:88:72:ce", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36083c4a-f1", "ovs_interfaceid": "36083c4a-f152-4716-a60d-0197287d6ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "address": "fa:16:3e:af:68:17", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cbdfd5-31", "ovs_interfaceid": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "address": "fa:16:3e:57:ac:38", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce0028f-12", "ovs_interfaceid": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "address": "fa:16:3e:fd:1c:be", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8e308b-ba", "ovs_interfaceid": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Releasing lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:25:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Instance network_info: |[{"id": "84ce2803-724b-484e-8673-6959fd03fdc9", "address": "fa:16:3e:c4:ce:d4", "network": {"id": "487458d7-109b-469f-914b-1d6d01919059", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-588553343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ce2803-72", "ovs_interfaceid": "84ce2803-724b-484e-8673-6959fd03fdc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44948ebb-503b-4166-936e-6c4101625453", "address": "fa:16:3e:8e:09:1e", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44948ebb-50", "ovs_interfaceid": "44948ebb-503b-4166-936e-6c4101625453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "350ec490-a274-4fe0-a88d-4d558e0d4337", "address": "fa:16:3e:b5:ee:af", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ec490-a2", "ovs_interfaceid": "350ec490-a274-4fe0-a88d-4d558e0d4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36083c4a-f152-4716-a60d-0197287d6ba1", "address": "fa:16:3e:88:72:ce", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36083c4a-f1", "ovs_interfaceid": "36083c4a-f152-4716-a60d-0197287d6ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "address": "fa:16:3e:af:68:17", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cbdfd5-31", "ovs_interfaceid": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "address": "fa:16:3e:57:ac:38", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce0028f-12", "ovs_interfaceid": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "address": "fa:16:3e:fd:1c:be", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8e308b-ba", "ovs_interfaceid": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:25:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] Acquired lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:25:31 user nova-compute[71711]: DEBUG nova.network.neutron [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing network info cache for port dce0028f-1206-43bb-96c1-d3cbd8f57103 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:25:31 user nova-compute[71711]: DEBUG nova.network.neutron [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updated VIF entry in instance network info cache for port dce0028f-1206-43bb-96c1-d3cbd8f57103. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:25:31 user nova-compute[71711]: DEBUG nova.network.neutron [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating instance_info_cache with network_info: [{"id": "84ce2803-724b-484e-8673-6959fd03fdc9", "address": "fa:16:3e:c4:ce:d4", "network": {"id": "487458d7-109b-469f-914b-1d6d01919059", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-588553343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ce2803-72", "ovs_interfaceid": "84ce2803-724b-484e-8673-6959fd03fdc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44948ebb-503b-4166-936e-6c4101625453", "address": "fa:16:3e:8e:09:1e", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44948ebb-50", "ovs_interfaceid": "44948ebb-503b-4166-936e-6c4101625453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "350ec490-a274-4fe0-a88d-4d558e0d4337", "address": "fa:16:3e:b5:ee:af", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ec490-a2", "ovs_interfaceid": "350ec490-a274-4fe0-a88d-4d558e0d4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36083c4a-f152-4716-a60d-0197287d6ba1", "address": "fa:16:3e:88:72:ce", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36083c4a-f1", "ovs_interfaceid": "36083c4a-f152-4716-a60d-0197287d6ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "address": "fa:16:3e:af:68:17", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cbdfd5-31", "ovs_interfaceid": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "address": "fa:16:3e:57:ac:38", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce0028f-12", "ovs_interfaceid": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "address": "fa:16:3e:fd:1c:be", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8e308b-ba", "ovs_interfaceid": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] Releasing lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:25:31 user nova-compute[71711]: DEBUG nova.compute.manager [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-changed-be8e308b-ba21-4e98-95bf-af2ae6446d20 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:31 user nova-compute[71711]: DEBUG nova.compute.manager [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing instance network info cache due to event network-changed-be8e308b-ba21-4e98-95bf-af2ae6446d20. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:25:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] Acquiring lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:25:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] Acquired lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:25:31 user nova-compute[71711]: DEBUG nova.network.neutron [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing network info cache for port be8e308b-ba21-4e98-95bf-af2ae6446d20 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:25:32 user nova-compute[71711]: DEBUG nova.network.neutron [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updated VIF entry in instance network info cache for port be8e308b-ba21-4e98-95bf-af2ae6446d20. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:25:32 user nova-compute[71711]: DEBUG nova.network.neutron [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating instance_info_cache with network_info: [{"id": "84ce2803-724b-484e-8673-6959fd03fdc9", "address": "fa:16:3e:c4:ce:d4", "network": {"id": "487458d7-109b-469f-914b-1d6d01919059", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-588553343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ce2803-72", "ovs_interfaceid": "84ce2803-724b-484e-8673-6959fd03fdc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44948ebb-503b-4166-936e-6c4101625453", "address": "fa:16:3e:8e:09:1e", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44948ebb-50", "ovs_interfaceid": "44948ebb-503b-4166-936e-6c4101625453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "350ec490-a274-4fe0-a88d-4d558e0d4337", "address": "fa:16:3e:b5:ee:af", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ec490-a2", "ovs_interfaceid": "350ec490-a274-4fe0-a88d-4d558e0d4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36083c4a-f152-4716-a60d-0197287d6ba1", "address": "fa:16:3e:88:72:ce", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36083c4a-f1", "ovs_interfaceid": "36083c4a-f152-4716-a60d-0197287d6ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "address": "fa:16:3e:af:68:17", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cbdfd5-31", "ovs_interfaceid": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "address": "fa:16:3e:57:ac:38", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce0028f-12", "ovs_interfaceid": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "address": "fa:16:3e:fd:1c:be", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8e308b-ba", "ovs_interfaceid": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cbc17fa5-fa4f-4396-98b9-66ed4992ab07 req-dad041db-8d39-4c0f-851b-13ad942e302f service nova] Releasing lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "33458552-cb23-41c7-9cb7-ef13301468f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:33 user nova-compute[71711]: INFO nova.compute.manager [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Terminating instance
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.compute.manager [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:25:33 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Creating image(s)
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Ensure instance console log exists: /opt/stack/data/nova/instances/d15be760-180e-4335-b670-ecd8873609b4/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Start _get_guest_xml network_info=[{"id": "84ce2803-724b-484e-8673-6959fd03fdc9", "address": "fa:16:3e:c4:ce:d4", "network": {"id": "487458d7-109b-469f-914b-1d6d01919059", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-588553343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ce2803-72", "ovs_interfaceid": "84ce2803-724b-484e-8673-6959fd03fdc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44948ebb-503b-4166-936e-6c4101625453", "address": "fa:16:3e:8e:09:1e", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44948ebb-50", "ovs_interfaceid": "44948ebb-503b-4166-936e-6c4101625453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "350ec490-a274-4fe0-a88d-4d558e0d4337", "address": "fa:16:3e:b5:ee:af", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ec490-a2", "ovs_interfaceid": "350ec490-a274-4fe0-a88d-4d558e0d4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36083c4a-f152-4716-a60d-0197287d6ba1", "address": "fa:16:3e:88:72:ce", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36083c4a-f1", "ovs_interfaceid": "36083c4a-f152-4716-a60d-0197287d6ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "address": "fa:16:3e:af:68:17", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cbdfd5-31", "ovs_interfaceid": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "address": "fa:16:3e:57:ac:38", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce0028f-12", "ovs_interfaceid": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "address": "fa:16:3e:fd:1c:be", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8e308b-ba", "ovs_interfaceid": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFGiWOnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd15be760-180e-4335-b670-ecd8873609b4', 'attached_at': '', 'detached_at': '', 'volume_id': '43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'serial': '43ddfeaf-9407-49e8-abb1-f5c9d23dab3f'}, 'attachment_id': '2ed55170-1be1-4564-8950-0a3ec073e131', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'device_type': 'disk', 'boot_index': 1, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOloYSmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd15be760-180e-4335-b670-ecd8873609b4', 'attached_at': '', 'detached_at': '', 'volume_id': '8c9b01f5-884d-4f16-b344-ea6facab9090', 'serial': '8c9b01f5-884d-4f16-b344-ea6facab9090'}, 'attachment_id': '2a42ffb3-97fa-4aad-b096-c50387e5cab7', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'device_type': 'disk', 'boot_index': 2, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIhHWXGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd15be760-180e-4335-b670-ecd8873609b4', 'attached_at': '', 'detached_at': '', 'volume_id': '6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'serial': '6c75bc08-5a02-4b60-9201-616a5a4f1d88'}, 'attachment_id': '5660e0e3-8e7d-473b-b61c-f8ea9e68e3a4', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:33 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:25:33 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFGiWOnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:25:33 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:25:33 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:25:33 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cc55d5-49ee-4083-81ed-08799f111caf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:25:33 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-90338f9f-5446-449f-b37f-ba3414b8551c req-396eb671-44a5-4bd3-b916-04a5dfe6f632 service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Received event network-vif-unplugged-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-90338f9f-5446-449f-b37f-ba3414b8551c req-396eb671-44a5-4bd3-b916-04a5dfe6f632 service nova] Acquiring lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-90338f9f-5446-449f-b37f-ba3414b8551c req-396eb671-44a5-4bd3-b916-04a5dfe6f632 service nova] Lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-90338f9f-5446-449f-b37f-ba3414b8551c req-396eb671-44a5-4bd3-b916-04a5dfe6f632 service nova] Lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-90338f9f-5446-449f-b37f-ba3414b8551c req-396eb671-44a5-4bd3-b916-04a5dfe6f632 service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] No waiting events found dispatching network-vif-unplugged-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-90338f9f-5446-449f-b37f-ba3414b8551c req-396eb671-44a5-4bd3-b916-04a5dfe6f632 service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Received event network-vif-unplugged-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[66da7ec1-cfcd-42de-b231-9e3baf5e5299]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f] added
Apr 12 06:25:33 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e71d1c-9da2-47df-83d6-24f368ae29d3]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bd430e-db14-428a-9ecf-55b833960c1c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFGiWOnX {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFGiWOnX" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc6530c-7522-4bf9-90b0-107de7f6ba7d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PFGiWOnX'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a9b698-82ab-4744-8961-6321d838861d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f70226-8b90-4fb5-9e56-183dee30f42d]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:33 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:33 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6632de6-8915-4422-9d2d-de9ed76187bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f, portal: 172.16.0.220,3260]
Apr 12 06:25:33 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f, portal: 172.16.0.220,3260] successful.
Apr 12 06:25:33 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b88eed-3f71-4672-b3e3-dc4f92d294fe]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc832d18-990b-49f2-8f09-4dafa7e7cca2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:33 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:33 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:33 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:33 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b36993-6643-4278-874e-c413db930638]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:25:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFGiWOnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:25:34 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Instance destroyed successfully.
Apr 12 06:25:34 user nova-compute[71711]: DEBUG nova.objects.instance [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lazy-loading 'resources' on Instance uuid 33458552-cb23-41c7-9cb7-ef13301468f6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280719.1459827, 2a24ff32-6994-4754-be34-7664bbe21d16 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:25:34 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] VM Stopped (Lifecycle Event)
Apr 12 06:25:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:22:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2009329208',display_name='tempest-TestVolumeSwap-server-2009329208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2009329208',id=7,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR2iwubxgd67bcfbYSIQ4InvaMveVw40BYu/RkOLGoTl7STVma0BPiTSi090ksb72jogJXIn3Y1rI+7tIGtilTjYycBsCQDhXALmgJddDEyoe9QKkV0XFtcCerGg6FL8Q==',key_name='tempest-keypair-1426278107',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff56a846b9e34aada0c72df46d47b77d',ramdisk_id='',reservation_id='r-8jieoqnt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1856443697',owner_user_name='tempest-TestVolumeSwap-1856443697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:22:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f053ed1c99c0480c9d1b0bc466e49e08',uuid=33458552-cb23-41c7-9cb7-ef13301468f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "address": "fa:16:3e:56:fb:fd", "network": {"id": "0b9e975b-f79a-4346-a4ba-543f9560aba7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1629057747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff56a846b9e34aada0c72df46d47b77d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ee077c-02", "ovs_interfaceid": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Converting VIF {"id": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "address": "fa:16:3e:56:fb:fd", "network": {"id": "0b9e975b-f79a-4346-a4ba-543f9560aba7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1629057747-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff56a846b9e34aada0c72df46d47b77d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6ee077c-02", "ovs_interfaceid": "f6ee077c-02a5-41ec-85b8-56bc6aeddd39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:fb:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ee077c-02a5-41ec-85b8-56bc6aeddd39,network=Network(0b9e975b-f79a-4346-a4ba-543f9560aba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ee077c-02') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG os_vif [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:fb:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ee077c-02a5-41ec-85b8-56bc6aeddd39,network=Network(0b9e975b-f79a-4346-a4ba-543f9560aba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ee077c-02') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6ee077c-02, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b9e085c7-b9d5-4f32-9b26-ac2bf277f307 None None] [instance: 2a24ff32-6994-4754-be34-7664bbe21d16] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:34 user nova-compute[71711]: INFO os_vif [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:fb:fd,bridge_name='br-int',has_traffic_filtering=True,id=f6ee077c-02a5-41ec-85b8-56bc6aeddd39,network=Network(0b9e975b-f79a-4346-a4ba-543f9560aba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6ee077c-02')
Apr 12 06:25:34 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Deleting instance files /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6_del
Apr 12 06:25:34 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Deletion of /opt/stack/data/nova/instances/33458552-cb23-41c7-9cb7-ef13301468f6_del complete
Apr 12 06:25:34 user nova-compute[71711]: INFO nova.compute.manager [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 06:25:34 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23166393837363634', 'path': '/dev/sdb'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166393837363634', 'path': '/dev/sdb'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:25:34 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Took 0.69 seconds to deallocate network for instance.
Apr 12 06:25:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-3ad96f6f-23ce-4831-84f7-69a9888c47dd req-330cb8ae-49a8-4046-af09-1e74f6f7ff65 service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Received event network-vif-deleted-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOloYSmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:25:34 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:25:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:25:34 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:25:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:25:34 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:25:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf14af23-8c6f-4719-8ef6-919e78def10a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:25:34 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b942458c-5210-4dac-ad06-ce304647b633]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090] added
Apr 12 06:25:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5bf8bb-de96-48ba-8417-d98eddf4d551]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf4d72d-06a3-4549-b1c4-8407b1600061]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOloYSmd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hOloYSmd" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4ac186-3308-4e48-819c-0a850aee69f4]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hOloYSmd'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[317d6426-2294-4cde-bbd1-1e6c12c4ae77]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e5996d-f173-4925-a31e-c43dddefdfee]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:35 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:35 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0922051-e396-4738-86bf-42ed492471e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090, portal: 172.16.0.220,3260]
Apr 12 06:25:35 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090, portal: 172.16.0.220,3260] successful.
Apr 12 06:25:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf491794-9322-41b2-857f-c99410aad3de]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1147828a-4fcf-4030-b8f8-cf3ad482cb7c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:35 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:35 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:35 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:35 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[016a416b-020c-4413-892d-0895533d97dd]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOloYSmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:25:35 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Deleted allocations for instance 33458552-cb23-41c7-9cb7-ef13301468f6
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-341fbfe0-7f2f-4f2c-ac8e-79919a06ebd8 tempest-TestVolumeSwap-1856443697 tempest-TestVolumeSwap-1856443697-project-member] Lock "33458552-cb23-41c7-9cb7-ef13301468f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.035s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-6abaddf5-4e98-431b-b9e9-766715ecaca7 req-3e61a966-229d-4312-8f0b-4c9bb633d334 service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Received event network-vif-plugged-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6abaddf5-4e98-431b-b9e9-766715ecaca7 req-3e61a966-229d-4312-8f0b-4c9bb633d334 service nova] Acquiring lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6abaddf5-4e98-431b-b9e9-766715ecaca7 req-3e61a966-229d-4312-8f0b-4c9bb633d334 service nova] Lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6abaddf5-4e98-431b-b9e9-766715ecaca7 req-3e61a966-229d-4312-8f0b-4c9bb633d334 service nova] Lock "33458552-cb23-41c7-9cb7-ef13301468f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-6abaddf5-4e98-431b-b9e9-766715ecaca7 req-3e61a966-229d-4312-8f0b-4c9bb633d334 service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] No waiting events found dispatching network-vif-plugged-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:35 user nova-compute[71711]: WARNING nova.compute.manager [req-6abaddf5-4e98-431b-b9e9-766715ecaca7 req-3e61a966-229d-4312-8f0b-4c9bb633d334 service nova] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Received unexpected event network-vif-plugged-f6ee077c-02a5-41ec-85b8-56bc6aeddd39 for instance with vm_state deleted and task_state None.
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23462373531336534', 'path': '/dev/sdc'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462373531336534', 'path': '/dev/sdc'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIhHWXGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:25:36 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:25:36 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:25:36 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ef2477-eff5-459f-9d3e-265ee67d9e42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:25:36 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c863184c-217a-47bb-aa28-ac2399c837cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88] added
Apr 12 06:25:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a31cef-51d6-43df-971a-d01048483c1a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[80203622-c4bf-49fe-b9fa-2074bb9df417]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIhHWXGq {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIhHWXGq" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7704028-faf0-42e3-b33c-eb982e94c0b8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vIhHWXGq'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbca21c2-3c08-4a61-b2b8-a9e2fd8cc264]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc70965-72fb-4284-903d-f0095c040b3b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:36 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:36 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:36 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:36 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d89c91d-2e8a-4d65-ba8d-88b6bf64bc2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88, portal: 172.16.0.220,3260]
Apr 12 06:25:36 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88, portal: 172.16.0.220,3260] successful.
Apr 12 06:25:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5670ba58-2496-410a-a21c-19c94074e0ad]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8ad91a-c261-4091-a476-f8431617d5a4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:36 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:36 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:36 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:36 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:36 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:36 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad815d26-0f4d-4236-9738-c23d0c6495ae]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:25:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIhHWXGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26265636266383237', 'path': '/dev/sdd'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265636266383237', 'path': '/dev/sdd'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84ce2803-724b-484e-8673-6959fd03fdc9", "address": "fa:16:3e:c4:ce:d4", "network": {"id": "487458d7-109b-469f-914b-1d6d01919059", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-588553343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ce2803-72", "ovs_interfaceid": "84ce2803-724b-484e-8673-6959fd03fdc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "84ce2803-724b-484e-8673-6959fd03fdc9", "address": "fa:16:3e:c4:ce:d4", "network": {"id": "487458d7-109b-469f-914b-1d6d01919059", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-588553343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ce2803-72", "ovs_interfaceid": "84ce2803-724b-484e-8673-6959fd03fdc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=84ce2803-724b-484e-8673-6959fd03fdc9,network=Network(487458d7-109b-469f-914b-1d6d01919059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ce2803-72') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44948ebb-503b-4166-936e-6c4101625453", "address": "fa:16:3e:8e:09:1e", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44948ebb-50", "ovs_interfaceid": "44948ebb-503b-4166-936e-6c4101625453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "44948ebb-503b-4166-936e-6c4101625453", "address": "fa:16:3e:8e:09:1e", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44948ebb-50", "ovs_interfaceid": "44948ebb-503b-4166-936e-6c4101625453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:09:1e,bridge_name='br-int',has_traffic_filtering=True,id=44948ebb-503b-4166-936e-6c4101625453,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44948ebb-50') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350ec490-a274-4fe0-a88d-4d558e0d4337", "address": "fa:16:3e:b5:ee:af", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ec490-a2", "ovs_interfaceid": "350ec490-a274-4fe0-a88d-4d558e0d4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "350ec490-a274-4fe0-a88d-4d558e0d4337", "address": "fa:16:3e:b5:ee:af", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ec490-a2", "ovs_interfaceid": "350ec490-a274-4fe0-a88d-4d558e0d4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:ee:af,bridge_name='br-int',has_traffic_filtering=True,id=350ec490-a274-4fe0-a88d-4d558e0d4337,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap350ec490-a2') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36083c4a-f152-4716-a60d-0197287d6ba1", "address": "fa:16:3e:88:72:ce", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36083c4a-f1", "ovs_interfaceid": "36083c4a-f152-4716-a60d-0197287d6ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "36083c4a-f152-4716-a60d-0197287d6ba1", "address": "fa:16:3e:88:72:ce", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36083c4a-f1", "ovs_interfaceid": "36083c4a-f152-4716-a60d-0197287d6ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:72:ce,bridge_name='br-int',has_traffic_filtering=True,id=36083c4a-f152-4716-a60d-0197287d6ba1,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36083c4a-f1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "address": "fa:16:3e:af:68:17", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cbdfd5-31", "ovs_interfaceid": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "address": "fa:16:3e:af:68:17", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cbdfd5-31", "ovs_interfaceid": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:68:17,bridge_name='br-int',has_traffic_filtering=True,id=22cbdfd5-3118-4729-87fb-5f9f6e4f005c,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cbdfd5-31') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "address": "fa:16:3e:57:ac:38", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce0028f-12", "ovs_interfaceid": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "address": "fa:16:3e:57:ac:38", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce0028f-12", "ovs_interfaceid": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:ac:38,bridge_name='br-int',has_traffic_filtering=True,id=dce0028f-1206-43bb-96c1-d3cbd8f57103,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce0028f-12') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "address": "fa:16:3e:fd:1c:be", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8e308b-ba", "ovs_interfaceid": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "address": "fa:16:3e:fd:1c:be", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8e308b-ba", "ovs_interfaceid": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=be8e308b-ba21-4e98-95bf-af2ae6446d20,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8e308b-ba') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.objects.instance [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lazy-loading 'pci_devices' on Instance uuid d15be760-180e-4335-b670-ecd8873609b4 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:25:37 user nova-compute[71711]:   <uuid>d15be760-180e-4335-b670-ecd8873609b4</uuid>
Apr 12 06:25:37 user nova-compute[71711]:   <name>instance-0000000c</name>
Apr 12 06:25:37 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:25:37 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:25:37 user nova-compute[71711]:   <metadata>
Apr 12 06:25:37 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:25:37 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:25:37 user nova-compute[71711]:       <nova:name>tempest-device-tagging-server-1994861012</nova:name>
Apr 12 06:25:37 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:25:33</nova:creationTime>
Apr 12 06:25:37 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:25:37 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:25:37 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:25:37 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:25:37 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:25:37 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:25:37 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:25:37 user nova-compute[71711]:       <nova:owner>
Apr 12 06:25:37 user nova-compute[71711]:         <nova:user uuid="38d195bbdaf94ac9bfdba8f76157a10f">tempest-TaggedBootDevicesTest-1618985724-project-member</nova:user>
Apr 12 06:25:37 user nova-compute[71711]:         <nova:project uuid="6b22588bca2c46f09b19d28bcf76db06">tempest-TaggedBootDevicesTest-1618985724</nova:project>
Apr 12 06:25:37 user nova-compute[71711]:       </nova:owner>
Apr 12 06:25:37 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:25:37 user nova-compute[71711]:       <nova:ports>
Apr 12 06:25:37 user nova-compute[71711]:         <nova:port uuid="84ce2803-724b-484e-8673-6959fd03fdc9">
Apr 12 06:25:37 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 06:25:37 user nova-compute[71711]:         </nova:port>
Apr 12 06:25:37 user nova-compute[71711]:         <nova:port uuid="44948ebb-503b-4166-936e-6c4101625453">
Apr 12 06:25:37 user nova-compute[71711]:           <nova:ip type="fixed" address="10.1.1.39" ipVersion="4"/>
Apr 12 06:25:37 user nova-compute[71711]:         </nova:port>
Apr 12 06:25:37 user nova-compute[71711]:         <nova:port uuid="350ec490-a274-4fe0-a88d-4d558e0d4337">
Apr 12 06:25:37 user nova-compute[71711]:           <nova:ip type="fixed" address="10.1.1.93" ipVersion="4"/>
Apr 12 06:25:37 user nova-compute[71711]:         </nova:port>
Apr 12 06:25:37 user nova-compute[71711]:         <nova:port uuid="36083c4a-f152-4716-a60d-0197287d6ba1">
Apr 12 06:25:37 user nova-compute[71711]:           <nova:ip type="fixed" address="10.1.1.224" ipVersion="4"/>
Apr 12 06:25:37 user nova-compute[71711]:         </nova:port>
Apr 12 06:25:37 user nova-compute[71711]:         <nova:port uuid="22cbdfd5-3118-4729-87fb-5f9f6e4f005c">
Apr 12 06:25:37 user nova-compute[71711]:           <nova:ip type="fixed" address="10.1.1.116" ipVersion="4"/>
Apr 12 06:25:37 user nova-compute[71711]:         </nova:port>
Apr 12 06:25:37 user nova-compute[71711]:         <nova:port uuid="dce0028f-1206-43bb-96c1-d3cbd8f57103">
Apr 12 06:25:37 user nova-compute[71711]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 06:25:37 user nova-compute[71711]:         </nova:port>
Apr 12 06:25:37 user nova-compute[71711]:         <nova:port uuid="be8e308b-ba21-4e98-95bf-af2ae6446d20">
Apr 12 06:25:37 user nova-compute[71711]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 06:25:37 user nova-compute[71711]:         </nova:port>
Apr 12 06:25:37 user nova-compute[71711]:       </nova:ports>
Apr 12 06:25:37 user nova-compute[71711]:     </nova:instance>
Apr 12 06:25:37 user nova-compute[71711]:   </metadata>
Apr 12 06:25:37 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:25:37 user nova-compute[71711]:     <system>
Apr 12 06:25:37 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:25:37 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:25:37 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:25:37 user nova-compute[71711]:       <entry name="serial">d15be760-180e-4335-b670-ecd8873609b4</entry>
Apr 12 06:25:37 user nova-compute[71711]:       <entry name="uuid">d15be760-180e-4335-b670-ecd8873609b4</entry>
Apr 12 06:25:37 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:25:37 user nova-compute[71711]:     </system>
Apr 12 06:25:37 user nova-compute[71711]:   </sysinfo>
Apr 12 06:25:37 user nova-compute[71711]:   <os>
Apr 12 06:25:37 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:25:37 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:25:37 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:25:37 user nova-compute[71711]:   </os>
Apr 12 06:25:37 user nova-compute[71711]:   <features>
Apr 12 06:25:37 user nova-compute[71711]:     <acpi/>
Apr 12 06:25:37 user nova-compute[71711]:     <apic/>
Apr 12 06:25:37 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:25:37 user nova-compute[71711]:   </features>
Apr 12 06:25:37 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:25:37 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:25:37 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:25:37 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:25:37 user nova-compute[71711]:   </clock>
Apr 12 06:25:37 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:25:37 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:25:37 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:25:37 user nova-compute[71711]:   </cpu>
Apr 12 06:25:37 user nova-compute[71711]:   <devices>
Apr 12 06:25:37 user nova-compute[71711]:     <disk type="file" device="cdrom">
Apr 12 06:25:37 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 06:25:37 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/d15be760-180e-4335-b670-ecd8873609b4/disk.config"/>
Apr 12 06:25:37 user nova-compute[71711]:       <target dev="hda" bus="ide"/>
Apr 12 06:25:37 user nova-compute[71711]:     </disk>
Apr 12 06:25:37 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:25:37 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:25:37 user nova-compute[71711]:       <source dev="/dev/sdb"/>
Apr 12 06:25:37 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:25:37 user nova-compute[71711]:       <serial>43ddfeaf-9407-49e8-abb1-f5c9d23dab3f</serial>
Apr 12 06:25:37 user nova-compute[71711]:     </disk>
Apr 12 06:25:37 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:25:37 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:25:37 user nova-compute[71711]:       <source dev="/dev/sdc"/>
Apr 12 06:25:37 user nova-compute[71711]:       <target dev="vdb" bus="virtio"/>
Apr 12 06:25:37 user nova-compute[71711]:       <serial>8c9b01f5-884d-4f16-b344-ea6facab9090</serial>
Apr 12 06:25:37 user nova-compute[71711]:     </disk>
Apr 12 06:25:37 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:25:37 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:25:37 user nova-compute[71711]:       <source dev="/dev/sdd"/>
Apr 12 06:25:37 user nova-compute[71711]:       <target dev="vdc" bus="virtio"/>
Apr 12 06:25:37 user nova-compute[71711]:       <serial>6c75bc08-5a02-4b60-9201-616a5a4f1d88</serial>
Apr 12 06:25:37 user nova-compute[71711]:     </disk>
Apr 12 06:25:37 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:25:37 user nova-compute[71711]:       <mac address="fa:16:3e:c4:ce:d4"/>
Apr 12 06:25:37 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:25:37 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:25:37 user nova-compute[71711]:       <target dev="tap84ce2803-72"/>
Apr 12 06:25:37 user nova-compute[71711]:     </interface>
Apr 12 06:25:37 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:25:37 user nova-compute[71711]:       <mac address="fa:16:3e:8e:09:1e"/>
Apr 12 06:25:37 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:25:37 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:25:37 user nova-compute[71711]:       <target dev="tap44948ebb-50"/>
Apr 12 06:25:37 user nova-compute[71711]:     </interface>
Apr 12 06:25:37 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:25:37 user nova-compute[71711]:       <mac address="fa:16:3e:b5:ee:af"/>
Apr 12 06:25:37 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:25:37 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:25:37 user nova-compute[71711]:       <target dev="tap350ec490-a2"/>
Apr 12 06:25:37 user nova-compute[71711]:     </interface>
Apr 12 06:25:37 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:25:37 user nova-compute[71711]:       <mac address="fa:16:3e:88:72:ce"/>
Apr 12 06:25:37 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:25:37 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:25:37 user nova-compute[71711]:       <target dev="tap36083c4a-f1"/>
Apr 12 06:25:37 user nova-compute[71711]:     </interface>
Apr 12 06:25:37 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:25:37 user nova-compute[71711]:       <mac address="fa:16:3e:af:68:17"/>
Apr 12 06:25:37 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:25:37 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:25:37 user nova-compute[71711]:       <target dev="tap22cbdfd5-31"/>
Apr 12 06:25:37 user nova-compute[71711]:     </interface>
Apr 12 06:25:37 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:25:37 user nova-compute[71711]:       <mac address="fa:16:3e:57:ac:38"/>
Apr 12 06:25:37 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:25:37 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:25:37 user nova-compute[71711]:       <target dev="tapdce0028f-12"/>
Apr 12 06:25:37 user nova-compute[71711]:     </interface>
Apr 12 06:25:37 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:25:37 user nova-compute[71711]:       <mac address="fa:16:3e:fd:1c:be"/>
Apr 12 06:25:37 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:25:37 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:25:37 user nova-compute[71711]:       <target dev="tapbe8e308b-ba"/>
Apr 12 06:25:37 user nova-compute[71711]:     </interface>
Apr 12 06:25:37 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:25:37 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/d15be760-180e-4335-b670-ecd8873609b4/console.log" append="off"/>
Apr 12 06:25:37 user nova-compute[71711]:     </serial>
Apr 12 06:25:37 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:25:37 user nova-compute[71711]:     <video>
Apr 12 06:25:37 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:25:37 user nova-compute[71711]:     </video>
Apr 12 06:25:37 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:25:37 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:25:37 user nova-compute[71711]:     </rng>
Apr 12 06:25:37 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:25:37 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:25:37 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:25:37 user nova-compute[71711]:     </memballoon>
Apr 12 06:25:37 user nova-compute[71711]:   </devices>
Apr 12 06:25:37 user nova-compute[71711]: </domain>
Apr 12 06:25:37 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84ce2803-724b-484e-8673-6959fd03fdc9", "address": "fa:16:3e:c4:ce:d4", "network": {"id": "487458d7-109b-469f-914b-1d6d01919059", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-588553343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ce2803-72", "ovs_interfaceid": "84ce2803-724b-484e-8673-6959fd03fdc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "84ce2803-724b-484e-8673-6959fd03fdc9", "address": "fa:16:3e:c4:ce:d4", "network": {"id": "487458d7-109b-469f-914b-1d6d01919059", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-588553343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ce2803-72", "ovs_interfaceid": "84ce2803-724b-484e-8673-6959fd03fdc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=84ce2803-724b-484e-8673-6959fd03fdc9,network=Network(487458d7-109b-469f-914b-1d6d01919059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ce2803-72') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=84ce2803-724b-484e-8673-6959fd03fdc9,network=Network(487458d7-109b-469f-914b-1d6d01919059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ce2803-72') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84ce2803-72, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84ce2803-72, col_values=(('external_ids', {'iface-id': '84ce2803-724b-484e-8673-6959fd03fdc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:ce:d4', 'vm-uuid': 'd15be760-180e-4335-b670-ecd8873609b4'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: INFO os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=84ce2803-724b-484e-8673-6959fd03fdc9,network=Network(487458d7-109b-469f-914b-1d6d01919059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ce2803-72')
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44948ebb-503b-4166-936e-6c4101625453", "address": "fa:16:3e:8e:09:1e", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44948ebb-50", "ovs_interfaceid": "44948ebb-503b-4166-936e-6c4101625453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "44948ebb-503b-4166-936e-6c4101625453", "address": "fa:16:3e:8e:09:1e", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44948ebb-50", "ovs_interfaceid": "44948ebb-503b-4166-936e-6c4101625453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:09:1e,bridge_name='br-int',has_traffic_filtering=True,id=44948ebb-503b-4166-936e-6c4101625453,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44948ebb-50') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:09:1e,bridge_name='br-int',has_traffic_filtering=True,id=44948ebb-503b-4166-936e-6c4101625453,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44948ebb-50') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44948ebb-50, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44948ebb-50, col_values=(('external_ids', {'iface-id': '44948ebb-503b-4166-936e-6c4101625453', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:09:1e', 'vm-uuid': 'd15be760-180e-4335-b670-ecd8873609b4'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: INFO os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:09:1e,bridge_name='br-int',has_traffic_filtering=True,id=44948ebb-503b-4166-936e-6c4101625453,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44948ebb-50')
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350ec490-a274-4fe0-a88d-4d558e0d4337", "address": "fa:16:3e:b5:ee:af", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ec490-a2", "ovs_interfaceid": "350ec490-a274-4fe0-a88d-4d558e0d4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "350ec490-a274-4fe0-a88d-4d558e0d4337", "address": "fa:16:3e:b5:ee:af", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ec490-a2", "ovs_interfaceid": "350ec490-a274-4fe0-a88d-4d558e0d4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:ee:af,bridge_name='br-int',has_traffic_filtering=True,id=350ec490-a274-4fe0-a88d-4d558e0d4337,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap350ec490-a2') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:ee:af,bridge_name='br-int',has_traffic_filtering=True,id=350ec490-a274-4fe0-a88d-4d558e0d4337,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap350ec490-a2') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap350ec490-a2, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap350ec490-a2, col_values=(('external_ids', {'iface-id': '350ec490-a274-4fe0-a88d-4d558e0d4337', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:ee:af', 'vm-uuid': 'd15be760-180e-4335-b670-ecd8873609b4'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: INFO os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:ee:af,bridge_name='br-int',has_traffic_filtering=True,id=350ec490-a274-4fe0-a88d-4d558e0d4337,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap350ec490-a2')
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36083c4a-f152-4716-a60d-0197287d6ba1", "address": "fa:16:3e:88:72:ce", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36083c4a-f1", "ovs_interfaceid": "36083c4a-f152-4716-a60d-0197287d6ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "36083c4a-f152-4716-a60d-0197287d6ba1", "address": "fa:16:3e:88:72:ce", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36083c4a-f1", "ovs_interfaceid": "36083c4a-f152-4716-a60d-0197287d6ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:72:ce,bridge_name='br-int',has_traffic_filtering=True,id=36083c4a-f152-4716-a60d-0197287d6ba1,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36083c4a-f1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:72:ce,bridge_name='br-int',has_traffic_filtering=True,id=36083c4a-f152-4716-a60d-0197287d6ba1,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36083c4a-f1') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36083c4a-f1, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36083c4a-f1, col_values=(('external_ids', {'iface-id': '36083c4a-f152-4716-a60d-0197287d6ba1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:72:ce', 'vm-uuid': 'd15be760-180e-4335-b670-ecd8873609b4'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: INFO os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:72:ce,bridge_name='br-int',has_traffic_filtering=True,id=36083c4a-f152-4716-a60d-0197287d6ba1,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36083c4a-f1')
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "address": "fa:16:3e:af:68:17", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cbdfd5-31", "ovs_interfaceid": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "address": "fa:16:3e:af:68:17", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cbdfd5-31", "ovs_interfaceid": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:68:17,bridge_name='br-int',has_traffic_filtering=True,id=22cbdfd5-3118-4729-87fb-5f9f6e4f005c,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cbdfd5-31') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:68:17,bridge_name='br-int',has_traffic_filtering=True,id=22cbdfd5-3118-4729-87fb-5f9f6e4f005c,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cbdfd5-31') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22cbdfd5-31, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22cbdfd5-31, col_values=(('external_ids', {'iface-id': '22cbdfd5-3118-4729-87fb-5f9f6e4f005c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:68:17', 'vm-uuid': 'd15be760-180e-4335-b670-ecd8873609b4'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: INFO os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:68:17,bridge_name='br-int',has_traffic_filtering=True,id=22cbdfd5-3118-4729-87fb-5f9f6e4f005c,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cbdfd5-31')
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "address": "fa:16:3e:57:ac:38", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce0028f-12", "ovs_interfaceid": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "address": "fa:16:3e:57:ac:38", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce0028f-12", "ovs_interfaceid": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:ac:38,bridge_name='br-int',has_traffic_filtering=True,id=dce0028f-1206-43bb-96c1-d3cbd8f57103,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce0028f-12') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:ac:38,bridge_name='br-int',has_traffic_filtering=True,id=dce0028f-1206-43bb-96c1-d3cbd8f57103,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce0028f-12') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdce0028f-12, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdce0028f-12, col_values=(('external_ids', {'iface-id': 'dce0028f-1206-43bb-96c1-d3cbd8f57103', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:ac:38', 'vm-uuid': 'd15be760-180e-4335-b670-ecd8873609b4'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:38 user nova-compute[71711]: INFO os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:ac:38,bridge_name='br-int',has_traffic_filtering=True,id=dce0028f-1206-43bb-96c1-d3cbd8f57103,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce0028f-12')
Apr 12 06:25:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "address": "fa:16:3e:fd:1c:be", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8e308b-ba", "ovs_interfaceid": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "address": "fa:16:3e:fd:1c:be", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8e308b-ba", "ovs_interfaceid": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=be8e308b-ba21-4e98-95bf-af2ae6446d20,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8e308b-ba') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=be8e308b-ba21-4e98-95bf-af2ae6446d20,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8e308b-ba') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe8e308b-ba, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe8e308b-ba, col_values=(('external_ids', {'iface-id': 'be8e308b-ba21-4e98-95bf-af2ae6446d20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:1c:be', 'vm-uuid': 'd15be760-180e-4335-b670-ecd8873609b4'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:38 user nova-compute[71711]: INFO os_vif [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=be8e308b-ba21-4e98-95bf-af2ae6446d20,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8e308b-ba')
Apr 12 06:25:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] No BDM found with device name hda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] No VIF found with MAC fa:16:3e:c4:ce:d4, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] No VIF found with MAC fa:16:3e:af:68:17, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:25:38 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Using config drive
Apr 12 06:25:38 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Creating config drive at /opt/stack/data/nova/instances/d15be760-180e-4335-b670-ecd8873609b4/disk.config
Apr 12 06:25:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d15be760-180e-4335-b670-ecd8873609b4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp04mn2v3r {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d15be760-180e-4335-b670-ecd8873609b4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp04mn2v3r" returned: 0 in 0.053s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG nova.objects.instance [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'flavor' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.008s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:39 user nova-compute[71711]: INFO nova.compute.manager [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Attaching volume d96a84d2-2151-4f60-a72b-25e84b80c975 to /dev/vdb
Apr 12 06:25:39 user nova-compute[71711]: DEBUG os_brick.utils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e8a455-05cc-4be7-913f-1b5dffde9681]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[819c5e73-ba48-4856-a57c-f32f1c101937]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eadd8d0-d896-454f-9265-a42e9d2afc42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f195cd4e-d1c5-4936-ba50-d4911af9f432]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:25:39 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:25:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[890bb39a-10e5-4166-a6b1-4841fec26e59]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG os_brick.utils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating existing volume attachment record: 79834751-8c5e-444f-af12-08bbec4e7de5 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-2f99ccfd-188a-4c42-b6b0-4c357cabdec7 req-473f511d-8e82-47d4-95a6-6e25bc87cf4e service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2f99ccfd-188a-4c42-b6b0-4c357cabdec7 req-473f511d-8e82-47d4-95a6-6e25bc87cf4e service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2f99ccfd-188a-4c42-b6b0-4c357cabdec7 req-473f511d-8e82-47d4-95a6-6e25bc87cf4e service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2f99ccfd-188a-4c42-b6b0-4c357cabdec7 req-473f511d-8e82-47d4-95a6-6e25bc87cf4e service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-2f99ccfd-188a-4c42-b6b0-4c357cabdec7 req-473f511d-8e82-47d4-95a6-6e25bc87cf4e service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:40 user nova-compute[71711]: WARNING nova.compute.manager [req-2f99ccfd-188a-4c42-b6b0-4c357cabdec7 req-473f511d-8e82-47d4-95a6-6e25bc87cf4e service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-84ce2803-724b-484e-8673-6959fd03fdc9 for instance with vm_state building and task_state spawning.
Apr 12 06:25:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:40 user nova-compute[71711]: INFO nova.compute.manager [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] instance snapshotting
Apr 12 06:25:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:40 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Beginning live snapshot process
Apr 12 06:25:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-4e84cd52-e665-4b08-81a6-1b3c1e0b2201 req-ce74da3c-4019-49d3-9151-a4a203e8e787 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-44948ebb-503b-4166-936e-6c4101625453 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4e84cd52-e665-4b08-81a6-1b3c1e0b2201 req-ce74da3c-4019-49d3-9151-a4a203e8e787 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4e84cd52-e665-4b08-81a6-1b3c1e0b2201 req-ce74da3c-4019-49d3-9151-a4a203e8e787 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4e84cd52-e665-4b08-81a6-1b3c1e0b2201 req-ce74da3c-4019-49d3-9151-a4a203e8e787 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-4e84cd52-e665-4b08-81a6-1b3c1e0b2201 req-ce74da3c-4019-49d3-9151-a4a203e8e787 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-44948ebb-503b-4166-936e-6c4101625453 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:40 user nova-compute[71711]: WARNING nova.compute.manager [req-4e84cd52-e665-4b08-81a6-1b3c1e0b2201 req-ce74da3c-4019-49d3-9151-a4a203e8e787 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-44948ebb-503b-4166-936e-6c4101625453 for instance with vm_state building and task_state spawning.
Apr 12 06:25:40 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'flavor' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquired lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'info_cache' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json -f qcow2 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json -f qcow2 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbkd6eer0/bae03e379ff84b18bcca9d28bc0b2e61.delta 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbkd6eer0/bae03e379ff84b18bcca9d28bc0b2e61.delta 1073741824" returned: 0 in 0.052s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:41 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 06:25:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updating instance_info_cache with network_info: [{"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Releasing lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:25:42 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Instance destroyed successfully.
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'resources' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-347561886',display_name='tempest-AttachVolumeTestJSON-server-347561886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-347561886',id=2,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwrNegtuUQxlGPyN3pFJ5X6ve+WFpWa8ZN5z88plFcMC7jAP25D92PakJ6yQbAkk2nQ1OF8Me+pJecej1aLutIgKjYku+yi3zY9Z7mDtSHYPVUZwc5/VPOAX8HIWorUMg==',key_name='tempest-keypair-673948167',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:21:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4f124d62c4d345d9af22f1557abca276',ramdisk_id='',reservation_id='r-l92zv936',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1680327736',owner_user_name='tempest-AttachVolumeTestJSON-1680327736-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:23:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d58cc232d0094bebacf147c6b61a0989',uuid=7dee97a4-9497-43c2-a688-7bedd1441885,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converting VIF {"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_vif [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e69d862-c0, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:42 user nova-compute[71711]: INFO os_vif [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0')
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmJGqRkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:25:42 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f946df18-15df-4387-8c90-6328f3b3d28d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:25:42 user nova-compute[71711]: No targets found.
Apr 12 06:25:42 user nova-compute[71711]: iSNS:
Apr 12 06:25:42 user nova-compute[71711]: No targets found.
Apr 12 06:25:42 user nova-compute[71711]: STATIC:
Apr 12 06:25:42 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:25:42 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:25:42 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:25:42 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090
Apr 12 06:25:42 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:25:42 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:25:42 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f
Apr 12 06:25:42 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:25:42 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:25:42 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88
Apr 12 06:25:42 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:25:42 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:25:42 user nova-compute[71711]: FIRMWARE:
Apr 12 06:25:42 user nova-compute[71711]: No targets found.
Apr 12 06:25:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:25:42 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:25:42 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bcace8-4d3f-479a-bd9b-109291fe892a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb5f1f1-478c-400e-8408-c866a56608f4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:42 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:42 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:42 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:42 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:42 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:42 user nova-compute[71711]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9961e415a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8'): ({'sdg'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Removing single pathed devices sdg {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac29298d-abce-4757-9739-16bacdbe246a]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6caacd-d1ef-4a5a-86b2-45a2676e4b4f]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flushing IO for device /dev/sdg {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:42 user nova-compute[71711]: WARNING nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-84ce2803-724b-484e-8673-6959fd03fdc9 for instance with vm_state building and task_state spawning.
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-350ec490-a274-4fe0-a88d-4d558e0d4337 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-350ec490-a274-4fe0-a88d-4d558e0d4337 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:42 user nova-compute[71711]: WARNING nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-350ec490-a274-4fe0-a88d-4d558e0d4337 for instance with vm_state building and task_state spawning.
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-350ec490-a274-4fe0-a88d-4d558e0d4337 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-350ec490-a274-4fe0-a88d-4d558e0d4337 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:42 user nova-compute[71711]: WARNING nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-350ec490-a274-4fe0-a88d-4d558e0d4337 for instance with vm_state building and task_state spawning.
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-36083c4a-f152-4716-a60d-0197287d6ba1 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-36083c4a-f152-4716-a60d-0197287d6ba1 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:42 user nova-compute[71711]: WARNING nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-36083c4a-f152-4716-a60d-0197287d6ba1 for instance with vm_state building and task_state spawning.
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-36083c4a-f152-4716-a60d-0197287d6ba1 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-36083c4a-f152-4716-a60d-0197287d6ba1 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:42 user nova-compute[71711]: WARNING nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-36083c4a-f152-4716-a60d-0197287d6ba1 for instance with vm_state building and task_state spawning.
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-22cbdfd5-3118-4729-87fb-5f9f6e4f005c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-22cbdfd5-3118-4729-87fb-5f9f6e4f005c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:42 user nova-compute[71711]: WARNING nova.compute.manager [req-9c05299d-64d1-4264-bb4d-04bb16fa5251 req-56223640-43c7-4375-a9c7-583ef6fe4261 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-22cbdfd5-3118-4729-87fb-5f9f6e4f005c for instance with vm_state building and task_state spawning.
Apr 12 06:25:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d372d85-48eb-4d5d-a224-5fc51c8d4912]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd97be40-7a41-46a0-bc5b-6b6c719a3f4b]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] SCSI volumes sdg have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1448509e-402d-4f6f-b761-f09da8679f59]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0904c13-e906-4e5b-b676-87ad4f1bbff9]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260]
Apr 12 06:25:42 user nova-compute[71711]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260] successful.
Apr 12 06:25:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[667a6475-773a-48a1-9754-4e1f45a5a59d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] <== disconnect_volume: return (406ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Start _get_guest_xml network_info=[{"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmJGqRkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '7dee97a4-9497-43c2-a688-7bedd1441885', 'attached_at': '', 'detached_at': '', 'volume_id': '34023a39-bbf4-4afb-948b-0bff9f563bb8', 'serial': '34023a39-bbf4-4afb-948b-0bff9f563bb8'}, 'attachment_id': '89896312-6c7c-4a65-a4f5-fd99ee079f77', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'numa_topology' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:42 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:25:42 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:25:42 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmJGqRkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:25:42 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:25:42 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:25:42 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:25:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-44948ebb-503b-4166-936e-6c4101625453 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-44948ebb-503b-4166-936e-6c4101625453 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:42 user nova-compute[71711]: WARNING nova.compute.manager [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-44948ebb-503b-4166-936e-6c4101625453 for instance with vm_state building and task_state spawning.
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-be8e308b-ba21-4e98-95bf-af2ae6446d20 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-be8e308b-ba21-4e98-95bf-af2ae6446d20 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:42 user nova-compute[71711]: WARNING nova.compute.manager [req-e3d09ed0-cc1f-4f7c-a258-94641d52f284 req-1c638656-e714-456d-80c3-4a22fe839610 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-be8e308b-ba21-4e98-95bf-af2ae6446d20 for instance with vm_state building and task_state spawning.
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1f505f-6b92-4408-bebd-f13bf677ca64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:25:42 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[182b0cc2-ed53-4751-a13d-c8414c98e78f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8] added
Apr 12 06:25:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[95928089-5071-4eda-a219-4d513657bc32]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbkd6eer0/bae03e379ff84b18bcca9d28bc0b2e61.delta /opt/stack/data/nova/instances/snapshots/tmpbkd6eer0/bae03e379ff84b18bcca9d28bc0b2e61 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[04004713-a34e-4e91-8d94-601f1b93f3cf]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmJGqRkQ {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmJGqRkQ" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbdfda1-e914-4c50-befd-3aaacd770cdf]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vmJGqRkQ'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b94a39-a619-4217-b264-e16bde8b5cd4]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.111s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[194f3cbd-8cb3-4c39-9727-97ed7fedb034]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:43 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:43 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:43 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:43 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:43 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:43 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[136b005b-57df-4f16-b9f4-5a28747eff8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260]
Apr 12 06:25:43 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260] successful.
Apr 12 06:25:43 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c982ad-8c1d-484e-b1a1-c579dba944cc]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b8e946-c156-4f17-8704-427bcb32f6cd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:43 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:43 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:43 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:43 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:43 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:43 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:43 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:43 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.455s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f04edc-901d-4740-bb9a-0676ce9337fb]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmJGqRkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbkd6eer0/bae03e379ff84b18bcca9d28bc0b2e61.delta /opt/stack/data/nova/instances/snapshots/tmpbkd6eer0/bae03e379ff84b18bcca9d28bc0b2e61" returned: 0 in 0.489s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:43 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Snapshot extracted, beginning image upload
Apr 12 06:25:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:25:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.502s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] <== connect_volume: return (1503ms) {'type': 'block', 'scsi_wwn': '26233643335623338', 'path': '/dev/sde'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233643335623338', 'path': '/dev/sde'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-347561886',display_name='tempest-AttachVolumeTestJSON-server-347561886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-347561886',id=2,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwrNegtuUQxlGPyN3pFJ5X6ve+WFpWa8ZN5z88plFcMC7jAP25D92PakJ6yQbAkk2nQ1OF8Me+pJecej1aLutIgKjYku+yi3zY9Z7mDtSHYPVUZwc5/VPOAX8HIWorUMg==',key_name='tempest-keypair-673948167',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:21:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4f124d62c4d345d9af22f1557abca276',ramdisk_id='',reservation_id='r-l92zv936',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1680327736',owner_user_name='tempest-AttachVolumeTestJSON-1680327736-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:23:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d58cc232d0094bebacf147c6b61a0989',uuid=7dee97a4-9497-43c2-a688-7bedd1441885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converting VIF {"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'pci_devices' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:25:44 user nova-compute[71711]:   <uuid>7dee97a4-9497-43c2-a688-7bedd1441885</uuid>
Apr 12 06:25:44 user nova-compute[71711]:   <name>instance-00000002</name>
Apr 12 06:25:44 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:25:44 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:25:44 user nova-compute[71711]:   <metadata>
Apr 12 06:25:44 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:25:44 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:25:44 user nova-compute[71711]:       <nova:name>tempest-AttachVolumeTestJSON-server-347561886</nova:name>
Apr 12 06:25:44 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:25:42</nova:creationTime>
Apr 12 06:25:44 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:25:44 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:25:44 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:25:44 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:25:44 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:25:44 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:25:44 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:25:44 user nova-compute[71711]:       <nova:owner>
Apr 12 06:25:44 user nova-compute[71711]:         <nova:user uuid="d58cc232d0094bebacf147c6b61a0989">tempest-AttachVolumeTestJSON-1680327736-project-member</nova:user>
Apr 12 06:25:44 user nova-compute[71711]:         <nova:project uuid="4f124d62c4d345d9af22f1557abca276">tempest-AttachVolumeTestJSON-1680327736</nova:project>
Apr 12 06:25:44 user nova-compute[71711]:       </nova:owner>
Apr 12 06:25:44 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:25:44 user nova-compute[71711]:       <nova:ports>
Apr 12 06:25:44 user nova-compute[71711]:         <nova:port uuid="1e69d862-c01c-48c7-8795-00233f9e7812">
Apr 12 06:25:44 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 06:25:44 user nova-compute[71711]:         </nova:port>
Apr 12 06:25:44 user nova-compute[71711]:       </nova:ports>
Apr 12 06:25:44 user nova-compute[71711]:     </nova:instance>
Apr 12 06:25:44 user nova-compute[71711]:   </metadata>
Apr 12 06:25:44 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:25:44 user nova-compute[71711]:     <system>
Apr 12 06:25:44 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:25:44 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:25:44 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:25:44 user nova-compute[71711]:       <entry name="serial">7dee97a4-9497-43c2-a688-7bedd1441885</entry>
Apr 12 06:25:44 user nova-compute[71711]:       <entry name="uuid">7dee97a4-9497-43c2-a688-7bedd1441885</entry>
Apr 12 06:25:44 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:25:44 user nova-compute[71711]:     </system>
Apr 12 06:25:44 user nova-compute[71711]:   </sysinfo>
Apr 12 06:25:44 user nova-compute[71711]:   <os>
Apr 12 06:25:44 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:25:44 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:25:44 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:25:44 user nova-compute[71711]:   </os>
Apr 12 06:25:44 user nova-compute[71711]:   <features>
Apr 12 06:25:44 user nova-compute[71711]:     <acpi/>
Apr 12 06:25:44 user nova-compute[71711]:     <apic/>
Apr 12 06:25:44 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:25:44 user nova-compute[71711]:   </features>
Apr 12 06:25:44 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:25:44 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:25:44 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:25:44 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:25:44 user nova-compute[71711]:   </clock>
Apr 12 06:25:44 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:25:44 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:25:44 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:25:44 user nova-compute[71711]:   </cpu>
Apr 12 06:25:44 user nova-compute[71711]:   <devices>
Apr 12 06:25:44 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:25:44 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:25:44 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk"/>
Apr 12 06:25:44 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:25:44 user nova-compute[71711]:     </disk>
Apr 12 06:25:44 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:25:44 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:25:44 user nova-compute[71711]:       <source dev="/dev/sde"/>
Apr 12 06:25:44 user nova-compute[71711]:       <target dev="vdb" bus="virtio"/>
Apr 12 06:25:44 user nova-compute[71711]:       <serial>34023a39-bbf4-4afb-948b-0bff9f563bb8</serial>
Apr 12 06:25:44 user nova-compute[71711]:     </disk>
Apr 12 06:25:44 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:25:44 user nova-compute[71711]:       <mac address="fa:16:3e:4c:89:31"/>
Apr 12 06:25:44 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:25:44 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:25:44 user nova-compute[71711]:       <target dev="tap1e69d862-c0"/>
Apr 12 06:25:44 user nova-compute[71711]:     </interface>
Apr 12 06:25:44 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:25:44 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/console.log" append="off"/>
Apr 12 06:25:44 user nova-compute[71711]:     </serial>
Apr 12 06:25:44 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:25:44 user nova-compute[71711]:     <video>
Apr 12 06:25:44 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:25:44 user nova-compute[71711]:     </video>
Apr 12 06:25:44 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:25:44 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:25:44 user nova-compute[71711]:     </rng>
Apr 12 06:25:44 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:25:44 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:25:44 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:25:44 user nova-compute[71711]:     </memballoon>
Apr 12 06:25:44 user nova-compute[71711]:   </devices>
Apr 12 06:25:44 user nova-compute[71711]: </domain>
Apr 12 06:25:44 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-22cbdfd5-3118-4729-87fb-5f9f6e4f005c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-22cbdfd5-3118-4729-87fb-5f9f6e4f005c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:44 user nova-compute[71711]: WARNING nova.compute.manager [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-22cbdfd5-3118-4729-87fb-5f9f6e4f005c for instance with vm_state building and task_state spawning.
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-dce0028f-1206-43bb-96c1-d3cbd8f57103 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-dce0028f-1206-43bb-96c1-d3cbd8f57103 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:44 user nova-compute[71711]: WARNING nova.compute.manager [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-dce0028f-1206-43bb-96c1-d3cbd8f57103 for instance with vm_state building and task_state spawning.
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-dce0028f-1206-43bb-96c1-d3cbd8f57103 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-dce0028f-1206-43bb-96c1-d3cbd8f57103 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:44 user nova-compute[71711]: WARNING nova.compute.manager [req-3210139b-b7ef-4b7f-a0bc-91ee4ed83d61 req-46b08852-cc90-4acf-bec5-ed63454a2e73 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-dce0028f-1206-43bb-96c1-d3cbd8f57103 for instance with vm_state building and task_state spawning.
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.154s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-cf0affe0-e4f2-47f0-9e99-bf36d535dcf6 req-2ca189d8-96e7-4229-86bb-d3b70d7f7046 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-be8e308b-ba21-4e98-95bf-af2ae6446d20 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cf0affe0-e4f2-47f0-9e99-bf36d535dcf6 req-2ca189d8-96e7-4229-86bb-d3b70d7f7046 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cf0affe0-e4f2-47f0-9e99-bf36d535dcf6 req-2ca189d8-96e7-4229-86bb-d3b70d7f7046 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cf0affe0-e4f2-47f0-9e99-bf36d535dcf6 req-2ca189d8-96e7-4229-86bb-d3b70d7f7046 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-cf0affe0-e4f2-47f0-9e99-bf36d535dcf6 req-2ca189d8-96e7-4229-86bb-d3b70d7f7046 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-be8e308b-ba21-4e98-95bf-af2ae6446d20 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:44 user nova-compute[71711]: WARNING nova.compute.manager [req-cf0affe0-e4f2-47f0-9e99-bf36d535dcf6 req-2ca189d8-96e7-4229-86bb-d3b70d7f7046 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-be8e308b-ba21-4e98-95bf-af2ae6446d20 for instance with vm_state building and task_state spawning.
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280744.9308543, d15be760-180e-4335-b670-ecd8873609b4 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:25:44 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d15be760-180e-4335-b670-ecd8873609b4] VM Resumed (Lifecycle Event)
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Cannot resize image /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'migration_context' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-347561886',display_name='tempest-AttachVolumeTestJSON-server-347561886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-347561886',id=2,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwrNegtuUQxlGPyN3pFJ5X6ve+WFpWa8ZN5z88plFcMC7jAP25D92PakJ6yQbAkk2nQ1OF8Me+pJecej1aLutIgKjYku+yi3zY9Z7mDtSHYPVUZwc5/VPOAX8HIWorUMg==',key_name='tempest-keypair-673948167',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:21:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4f124d62c4d345d9af22f1557abca276',ramdisk_id='',reservation_id='r-l92zv936',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1680327736',owner_user_name='tempest-AttachVolumeTestJSON-1680327736-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:23:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d58cc232d0094bebacf147c6b61a0989',uuid=7dee97a4-9497-43c2-a688-7bedd1441885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converting VIF {"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG os_vif [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:25:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: d15be760-180e-4335-b670-ecd8873609b4] Instance spawned successfully.
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d15be760-180e-4335-b670-ecd8873609b4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e69d862-c0, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e69d862-c0, col_values=(('external_ids', {'iface-id': '1e69d862-c01c-48c7-8795-00233f9e7812', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:89:31', 'vm-uuid': '7dee97a4-9497-43c2-a688-7bedd1441885'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:45 user nova-compute[71711]: INFO os_vif [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0')
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d15be760-180e-4335-b670-ecd8873609b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:25:45 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d15be760-180e-4335-b670-ecd8873609b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280744.9316976, d15be760-180e-4335-b670-ecd8873609b4 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:25:45 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d15be760-180e-4335-b670-ecd8873609b4] VM Started (Lifecycle Event)
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d15be760-180e-4335-b670-ecd8873609b4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d15be760-180e-4335-b670-ecd8873609b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:25:45 user nova-compute[71711]: INFO nova.compute.manager [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Took 11.64 seconds to spawn the instance on the hypervisor.
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:45 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d15be760-180e-4335-b670-ecd8873609b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:25:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoTzegHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:25:45 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:25:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:25:45 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:25:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:25:45 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ffcecd-cf5e-40b0-a1b2-c841050b0446]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:25:45 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6150e778-8f1f-4c8d-bea2-cd3c396fc84b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975] added
Apr 12 06:25:45 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:45 user nova-compute[71711]: INFO nova.compute.manager [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Took 27.01 seconds to build instance.
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab305e1-3ba4-4750-a9f8-74e7b76551a5]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3fdc84b6-7254-43cc-b41c-61d7424e4d7a tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "d15be760-180e-4335-b670-ecd8873609b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.104s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d73cf50-57fd-48f1-8309-be64f8a4c4b2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoTzegHP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoTzegHP" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7643ae-3f1e-42fc-9dcd-139a73160a01]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AoTzegHP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d49900-1a5f-44aa-99be-f1348aca5d77]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bfdc0e-db13-4d48-95c4-a70c8cf922ec]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:46 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:25:46 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:25:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8310MB free_disk=26.52112579345703GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:46 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Snapshot image upload complete
Apr 12 06:25:46 user nova-compute[71711]: INFO nova.compute.manager [None req-a09cc119-c8fd-41db-8f7c-7aaa67a64f1f tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Took 5.68 seconds to snapshot the instance on the hypervisor.
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0f17ab-08b1-4ccd-9e52-56baff3fe313]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260]
Apr 12 06:25:46 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260] successful.
Apr 12 06:25:46 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7baefe-1451-4a2c-b2a7-eedf61d0caf7]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[828965cc-22fe-4b8f-933f-bf9e33124422]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:25:46 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.980s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7dee97a4-9497-43c2-a688-7bedd1441885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance a528e600-7358-4b92-9b71-12759f405b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance d15be760-180e-4335-b670-ecd8873609b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[704032f9-bfb9-4392-b4aa-ddbe35f7736f]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoTzegHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-855a1755-d587-4c4b-8028-19931d13234e req-33c03701-8783-40e8-abdd-44e0499f3014 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-855a1755-d587-4c4b-8028-19931d13234e req-33c03701-8783-40e8-abdd-44e0499f3014 service nova] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-855a1755-d587-4c4b-8028-19931d13234e req-33c03701-8783-40e8-abdd-44e0499f3014 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-855a1755-d587-4c4b-8028-19931d13234e req-33c03701-8783-40e8-abdd-44e0499f3014 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-855a1755-d587-4c4b-8028-19931d13234e req-33c03701-8783-40e8-abdd-44e0499f3014 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] No waiting events found dispatching network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:46 user nova-compute[71711]: WARNING nova.compute.manager [req-855a1755-d587-4c4b-8028-19931d13234e req-33c03701-8783-40e8-abdd-44e0499f3014 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received unexpected event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 for instance with vm_state stopped and task_state powering-on.
Apr 12 06:25:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.018s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:25:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== connect_volume: return (2020ms) {'type': 'block', 'scsi_wwn': '23830653063646534', 'path': '/dev/sdf'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:25:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830653063646534', 'path': '/dev/sdf'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:25:47 user nova-compute[71711]: DEBUG nova.objects.instance [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'flavor' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:25:47 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:25:47 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:25:47 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:25:47 user nova-compute[71711]:   <serial>d96a84d2-2151-4f60-a72b-25e84b80c975</serial>
Apr 12 06:25:47 user nova-compute[71711]: </disk>
Apr 12 06:25:47 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:25:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:25:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:25:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No VIF found with MAC fa:16:3e:7c:bb:4d, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:25:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-20b4908c-5dfd-43f6-93f5-53a12dc99b4a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.531s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:48 user nova-compute[71711]: DEBUG nova.compute.manager [req-8885bf68-49ed-47b2-92e2-a87109f29aeb req-af86f3de-5863-4508-99a5-d1f7c07b5075 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8885bf68-49ed-47b2-92e2-a87109f29aeb req-af86f3de-5863-4508-99a5-d1f7c07b5075 service nova] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8885bf68-49ed-47b2-92e2-a87109f29aeb req-af86f3de-5863-4508-99a5-d1f7c07b5075 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8885bf68-49ed-47b2-92e2-a87109f29aeb req-af86f3de-5863-4508-99a5-d1f7c07b5075 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:48 user nova-compute[71711]: DEBUG nova.compute.manager [req-8885bf68-49ed-47b2-92e2-a87109f29aeb req-af86f3de-5863-4508-99a5-d1f7c07b5075 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] No waiting events found dispatching network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:48 user nova-compute[71711]: WARNING nova.compute.manager [req-8885bf68-49ed-47b2-92e2-a87109f29aeb req-af86f3de-5863-4508-99a5-d1f7c07b5075 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received unexpected event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 for instance with vm_state stopped and task_state powering-on.
Apr 12 06:25:48 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280748.7738166, 7dee97a4-9497-43c2-a688-7bedd1441885 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:25:48 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] VM Resumed (Lifecycle Event)
Apr 12 06:25:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:25:48 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Instance rebooted successfully.
Apr 12 06:25:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e5a92f38-3f61-4ffb-bdd5-74d54fd44ced tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:48 user nova-compute[71711]: INFO nova.compute.manager [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Rebuilding instance
Apr 12 06:25:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:25:48 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 06:25:48 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280748.7751873, 7dee97a4-9497-43c2-a688-7bedd1441885 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:25:48 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] VM Started (Lifecycle Event)
Apr 12 06:25:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:25:48 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'pci_requests' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'resources' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'migration_context' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71711) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280734.1306882, 33458552-cb23-41c7-9cb7-ef13301468f6 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:25:49 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] VM Stopped (Lifecycle Event)
Apr 12 06:25:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1bc5ca66-b99f-463a-bbd2-c73532677423 None None] [instance: 33458552-cb23-41c7-9cb7-ef13301468f6] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-82b7f342-49d0-4848-8046-f901287fab59 req-c7afea08-b856-48c7-80d4-2b37bba8a3d4 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-82b7f342-49d0-4848-8046-f901287fab59 req-c7afea08-b856-48c7-80d4-2b37bba8a3d4 service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-82b7f342-49d0-4848-8046-f901287fab59 req-c7afea08-b856-48c7-80d4-2b37bba8a3d4 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-82b7f342-49d0-4848-8046-f901287fab59 req-c7afea08-b856-48c7-80d4-2b37bba8a3d4 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-82b7f342-49d0-4848-8046-f901287fab59 req-c7afea08-b856-48c7-80d4-2b37bba8a3d4 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:49 user nova-compute[71711]: WARNING nova.compute.manager [req-82b7f342-49d0-4848-8046-f901287fab59 req-c7afea08-b856-48c7-80d4-2b37bba8a3d4 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state active and task_state rebuilding.
Apr 12 06:25:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:49 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance destroyed successfully.
Apr 12 06:25:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:50 user nova-compute[71711]: INFO nova.compute.manager [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Detaching volume d96a84d2-2151-4f60-a72b-25e84b80c975
Apr 12 06:25:50 user nova-compute[71711]: INFO nova.virt.block_device [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Attempting to driver detach volume d96a84d2-2151-4f60-a72b-25e84b80c975 from mountpoint /dev/vdb
Apr 12 06:25:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Attempting to detach device vdb from instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:25:50 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:25:50 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:25:50 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:25:50 user nova-compute[71711]:   <serial>d96a84d2-2151-4f60-a72b-25e84b80c975</serial>
Apr 12 06:25:50 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:25:50 user nova-compute[71711]: </disk>
Apr 12 06:25:50 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:25:50 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully detached device vdb from instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 from the persistent domain config.
Apr 12 06:25:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoTzegHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:25:50 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7e01d3-854c-4817-bd75-158c8badd960]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:25:50 user nova-compute[71711]: No targets found.
Apr 12 06:25:50 user nova-compute[71711]: iSNS:
Apr 12 06:25:50 user nova-compute[71711]: No targets found.
Apr 12 06:25:50 user nova-compute[71711]: STATIC:
Apr 12 06:25:50 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:25:50 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:25:50 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:25:50 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090
Apr 12 06:25:50 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:25:50 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:25:50 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f
Apr 12 06:25:50 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:25:50 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:25:50 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88
Apr 12 06:25:50 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:25:50 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:25:50 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975
Apr 12 06:25:50 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:25:50 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:25:50 user nova-compute[71711]: FIRMWARE:
Apr 12 06:25:50 user nova-compute[71711]: No targets found.
Apr 12 06:25:50 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:25:50 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:25:50 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88c68db-c3d0-4278-a115-6183a1598432]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a61965-1fc7-426c-8db7-f43bbcb85665]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:50 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:50 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:50 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:50 user nova-compute[71711]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:25:50 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:50 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:50 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:50 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:50 user nova-compute[71711]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:25:50 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c270040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975'): ({'sdf'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Removing single pathed devices sdf {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5c8065-cf27-4947-80e9-45a91f546764]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[542ebb86-6b9d-485e-b39e-4a6048b1f1ab]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flushing IO for device /dev/sdf {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2594c00b-e103-410e-80e8-83afbc387e03]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35d4f22-b8aa-4755-9131-0067a784dd0a]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a20b9e1-b633-40cb-8f5f-b27cf14ddf33]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33677bd-6863-4a19-9ea4-8b3265f6ce2e]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260]
Apr 12 06:25:50 user nova-compute[71711]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260] successful.
Apr 12 06:25:50 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[710c739d-d153-4f9f-983d-7e37f5c0ee67]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== disconnect_volume: return (396ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:51 user nova-compute[71711]: DEBUG nova.compute.manager [req-26273d25-74b8-4a21-be98-f8839b613cb2 req-fe3e72f9-34d9-4733-b4fa-59ce990ebfd5 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-26273d25-74b8-4a21-be98-f8839b613cb2 req-fe3e72f9-34d9-4733-b4fa-59ce990ebfd5 service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-26273d25-74b8-4a21-be98-f8839b613cb2 req-fe3e72f9-34d9-4733-b4fa-59ce990ebfd5 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-26273d25-74b8-4a21-be98-f8839b613cb2 req-fe3e72f9-34d9-4733-b4fa-59ce990ebfd5 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:51 user nova-compute[71711]: DEBUG nova.compute.manager [req-26273d25-74b8-4a21-be98-f8839b613cb2 req-fe3e72f9-34d9-4733-b4fa-59ce990ebfd5 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:51 user nova-compute[71711]: WARNING nova.compute.manager [req-26273d25-74b8-4a21-be98-f8839b613cb2 req-fe3e72f9-34d9-4733-b4fa-59ce990ebfd5 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state active and task_state rebuilding.
Apr 12 06:25:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:51 user nova-compute[71711]: DEBUG nova.compute.manager [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:25:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:51 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:25:51 user nova-compute[71711]: INFO nova.compute.claims [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Claim successful on node user
Apr 12 06:25:52 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:25:52 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:25:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:25:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:25:52 user nova-compute[71711]: DEBUG nova.network.neutron [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:25:52 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:25:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:25:52 user nova-compute[71711]: DEBUG nova.policy [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd59314e79d0344a2943391c3c2ab628a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7d74130d4d417a93de352381229948', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:25:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:25:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:25:52 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Creating image(s)
Apr 12 06:25:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "/opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "/opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "/opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b.part --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG nova.network.neutron [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Successfully created port: 491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b.part --force-share --output=json" returned: 0 in 0.170s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG nova.virt.images [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 1a9eeca1-ea38-407f-a16c-de352efc9154 was qcow2, converting to raw {{(pid=71711) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b.part /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b.converted {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b.part /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b.converted" returned: 0 in 0.168s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b.converted --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:53 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance destroyed successfully.
Apr 12 06:25:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1807692588',display_name='tempest-ServerActionsTestJSON-server-1279128249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1807692588',id=4,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-hktvsdi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=5b5758b9-4f7e-4e85-8181-e3dfdd84e624,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG os_vif [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fba3fe8-62, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:53 user nova-compute[71711]: INFO os_vif [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62')
Apr 12 06:25:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoTzegHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:25:53 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 06:25:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3fd5bb-1e19-4cbb-8fb8-8c598b8286d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:25:53 user nova-compute[71711]: No targets found.
Apr 12 06:25:53 user nova-compute[71711]: iSNS:
Apr 12 06:25:53 user nova-compute[71711]: No targets found.
Apr 12 06:25:53 user nova-compute[71711]: STATIC:
Apr 12 06:25:53 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:25:53 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:25:53 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:25:53 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090
Apr 12 06:25:53 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:25:53 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:25:53 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f
Apr 12 06:25:53 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:25:53 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:25:53 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88
Apr 12 06:25:53 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:25:53 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:25:53 user nova-compute[71711]: FIRMWARE:
Apr 12 06:25:53 user nova-compute[71711]: No targets found.
Apr 12 06:25:53 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:25:53 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:25:53 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ba7fe7-7f6a-4fc7-a53d-ac4c9742a569]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.231s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[010afcab-7e99-4bc2-8359-e5c780876176]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:53 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:53 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:53 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:53 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:25:53 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:25:53 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:25:53 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:25:53 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c1b8dc0>, {}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Disconnecting from: [] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.152s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== disconnect_volume: return (154ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:25:53 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Deleting instance files /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624_del
Apr 12 06:25:53 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Deletion of /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624_del complete
Apr 12 06:25:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b --force-share --output=json" returned: 0 in 0.193s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b --force-share --output=json" returned: 0 in 0.165s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b,backing_fmt=raw /opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:53 user nova-compute[71711]: DEBUG nova.network.neutron [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Successfully updated port: 491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:25:54 user nova-compute[71711]: INFO nova.virt.block_device [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Booting with volume d96a84d2-2151-4f60-a72b-25e84b80c975 at /dev/vdb
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b,backing_fmt=raw /opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk 1073741824" returned: 0 in 0.074s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "refresh_cache-adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquired lock "refresh_cache-adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Received event network-changed-491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Refreshing instance network info cache due to event network-changed-491bd5ef-7e10-49f3-ae6e-3804489ade6f. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] Acquiring lock "refresh_cache-adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG os_brick.utils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bc0c99-c2be-4488-baaf-3df6fcf24e3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b --force-share --output=json" returned: 0 in 0.159s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.objects.instance [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'migration_context' on Instance uuid adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2d512c-3254-4ca7-a749-eaaa1b9f0c2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Ensure instance console log exists: /opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d84e68-72c2-4fb6-a572-20c95dcc5256]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[af361039-637e-447a-a2a2-439aa7beaed6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:25:54 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a97a288-f7de-44dc-b8f6-eae7332e20b9]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG os_brick.utils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating existing volume attachment record: 14e8b92f-dc90-46e2-bc83-3ab6e56643a2 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Updating instance_info_cache with network_info: [{"id": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "address": "fa:16:3e:c0:49:12", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491bd5ef-7e", "ovs_interfaceid": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Releasing lock "refresh_cache-adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Instance network_info: |[{"id": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "address": "fa:16:3e:c0:49:12", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491bd5ef-7e", "ovs_interfaceid": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] Acquired lock "refresh_cache-adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.network.neutron [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Refreshing network info cache for port 491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Start _get_guest_xml network_info=[{"id": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "address": "fa:16:3e:c0:49:12", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491bd5ef-7e", "ovs_interfaceid": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e0b738b9eea6023fea6ffe7d485198c9',container_format='bare',created_at=2023-04-12T06:25:40Z,direct_url=<?>,disk_format='qcow2',id=1a9eeca1-ea38-407f-a16c-de352efc9154,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-361839817',owner='5a7d74130d4d417a93de352381229948',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T06:25:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '1a9eeca1-ea38-407f-a16c-de352efc9154'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:25:54 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:25:54 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e0b738b9eea6023fea6ffe7d485198c9',container_format='bare',created_at=2023-04-12T06:25:40Z,direct_url=<?>,disk_format='qcow2',id=1a9eeca1-ea38-407f-a16c-de352efc9154,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-361839817',owner='5a7d74130d4d417a93de352381229948',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T06:25:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-87019523',display_name='tempest-TestStampPattern-server-87019523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-87019523',id=13,image_ref='1a9eeca1-ea38-407f-a16c-de352efc9154',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4bTwZ/jGMekzeEcO14GzYK3DGdo+oNI7mA/YkJRKaAKcLzVE0FyC6M9scMJglXnoXkUOrevnkhp2qnhWOlMGwLE9qftr8ybB+0jBRxkTjyexl7VDlmRC5pzxifapKyKw==',key_name='tempest-TestStampPattern-1405244377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7d74130d4d417a93de352381229948',ramdisk_id='',reservation_id='r-m117mluh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a528e600-7358-4b92-9b71-12759f405b38',image_min_disk='1',image_min_ram='0',image_owner_id='5a7d74130d4d417a93de352381229948',image_owner_project_name='tempest-TestStampPattern-1782553765',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1782553765-project-member',image_user_id='d59314e79d0344a2943391c3c2ab628a',network_allocated='True',owner_project_name='tempest-TestStampPattern-1782553765',owner_user_name='tempest-TestStampPattern-1782553765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:52Z,user_data=None,user_id='d59314e79d0344a2943391c3c2ab628a',uuid=adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "address": "fa:16:3e:c0:49:12", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491bd5ef-7e", "ovs_interfaceid": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Converting VIF {"id": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "address": "fa:16:3e:c0:49:12", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491bd5ef-7e", "ovs_interfaceid": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:49:12,bridge_name='br-int',has_traffic_filtering=True,id=491bd5ef-7e10-49f3-ae6e-3804489ade6f,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491bd5ef-7e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.objects.instance [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'pci_devices' on Instance uuid adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:25:54 user nova-compute[71711]:   <uuid>adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf</uuid>
Apr 12 06:25:54 user nova-compute[71711]:   <name>instance-0000000d</name>
Apr 12 06:25:54 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:25:54 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:25:54 user nova-compute[71711]:   <metadata>
Apr 12 06:25:54 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:25:54 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:25:54 user nova-compute[71711]:       <nova:name>tempest-TestStampPattern-server-87019523</nova:name>
Apr 12 06:25:54 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:25:54</nova:creationTime>
Apr 12 06:25:54 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:25:54 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:25:54 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:25:54 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:25:54 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:25:54 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:25:54 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:25:54 user nova-compute[71711]:       <nova:owner>
Apr 12 06:25:54 user nova-compute[71711]:         <nova:user uuid="d59314e79d0344a2943391c3c2ab628a">tempest-TestStampPattern-1782553765-project-member</nova:user>
Apr 12 06:25:54 user nova-compute[71711]:         <nova:project uuid="5a7d74130d4d417a93de352381229948">tempest-TestStampPattern-1782553765</nova:project>
Apr 12 06:25:54 user nova-compute[71711]:       </nova:owner>
Apr 12 06:25:54 user nova-compute[71711]:       <nova:root type="image" uuid="1a9eeca1-ea38-407f-a16c-de352efc9154"/>
Apr 12 06:25:54 user nova-compute[71711]:       <nova:ports>
Apr 12 06:25:54 user nova-compute[71711]:         <nova:port uuid="491bd5ef-7e10-49f3-ae6e-3804489ade6f">
Apr 12 06:25:54 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 06:25:54 user nova-compute[71711]:         </nova:port>
Apr 12 06:25:54 user nova-compute[71711]:       </nova:ports>
Apr 12 06:25:54 user nova-compute[71711]:     </nova:instance>
Apr 12 06:25:54 user nova-compute[71711]:   </metadata>
Apr 12 06:25:54 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:25:54 user nova-compute[71711]:     <system>
Apr 12 06:25:54 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:25:54 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:25:54 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:25:54 user nova-compute[71711]:       <entry name="serial">adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf</entry>
Apr 12 06:25:54 user nova-compute[71711]:       <entry name="uuid">adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf</entry>
Apr 12 06:25:54 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:25:54 user nova-compute[71711]:     </system>
Apr 12 06:25:54 user nova-compute[71711]:   </sysinfo>
Apr 12 06:25:54 user nova-compute[71711]:   <os>
Apr 12 06:25:54 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:25:54 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:25:54 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:25:54 user nova-compute[71711]:   </os>
Apr 12 06:25:54 user nova-compute[71711]:   <features>
Apr 12 06:25:54 user nova-compute[71711]:     <acpi/>
Apr 12 06:25:54 user nova-compute[71711]:     <apic/>
Apr 12 06:25:54 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:25:54 user nova-compute[71711]:   </features>
Apr 12 06:25:54 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:25:54 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:25:54 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:25:54 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:25:54 user nova-compute[71711]:   </clock>
Apr 12 06:25:54 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:25:54 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:25:54 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:25:54 user nova-compute[71711]:   </cpu>
Apr 12 06:25:54 user nova-compute[71711]:   <devices>
Apr 12 06:25:54 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:25:54 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:25:54 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk"/>
Apr 12 06:25:54 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:25:54 user nova-compute[71711]:     </disk>
Apr 12 06:25:54 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:25:54 user nova-compute[71711]:       <mac address="fa:16:3e:c0:49:12"/>
Apr 12 06:25:54 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:25:54 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:25:54 user nova-compute[71711]:       <target dev="tap491bd5ef-7e"/>
Apr 12 06:25:54 user nova-compute[71711]:     </interface>
Apr 12 06:25:54 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:25:54 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/console.log" append="off"/>
Apr 12 06:25:54 user nova-compute[71711]:     </serial>
Apr 12 06:25:54 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:25:54 user nova-compute[71711]:     <video>
Apr 12 06:25:54 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:25:54 user nova-compute[71711]:     </video>
Apr 12 06:25:54 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:25:54 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:25:54 user nova-compute[71711]:     </rng>
Apr 12 06:25:54 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:25:54 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:25:54 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:25:54 user nova-compute[71711]:     </memballoon>
Apr 12 06:25:54 user nova-compute[71711]:   </devices>
Apr 12 06:25:54 user nova-compute[71711]: </domain>
Apr 12 06:25:54 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-87019523',display_name='tempest-TestStampPattern-server-87019523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-87019523',id=13,image_ref='1a9eeca1-ea38-407f-a16c-de352efc9154',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4bTwZ/jGMekzeEcO14GzYK3DGdo+oNI7mA/YkJRKaAKcLzVE0FyC6M9scMJglXnoXkUOrevnkhp2qnhWOlMGwLE9qftr8ybB+0jBRxkTjyexl7VDlmRC5pzxifapKyKw==',key_name='tempest-TestStampPattern-1405244377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7d74130d4d417a93de352381229948',ramdisk_id='',reservation_id='r-m117mluh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a528e600-7358-4b92-9b71-12759f405b38',image_min_disk='1',image_min_ram='0',image_owner_id='5a7d74130d4d417a93de352381229948',image_owner_project_name='tempest-TestStampPattern-1782553765',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1782553765-project-member',image_user_id='d59314e79d0344a2943391c3c2ab628a',network_allocated='True',owner_project_name='tempest-TestStampPattern-1782553765',owner_user_name='tempest-TestStampPattern-1782553765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:52Z,user_data=None,user_id='d59314e79d0344a2943391c3c2ab628a',uuid=adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "address": "fa:16:3e:c0:49:12", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491bd5ef-7e", "ovs_interfaceid": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Converting VIF {"id": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "address": "fa:16:3e:c0:49:12", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491bd5ef-7e", "ovs_interfaceid": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:49:12,bridge_name='br-int',has_traffic_filtering=True,id=491bd5ef-7e10-49f3-ae6e-3804489ade6f,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491bd5ef-7e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG os_vif [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:49:12,bridge_name='br-int',has_traffic_filtering=True,id=491bd5ef-7e10-49f3-ae6e-3804489ade6f,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491bd5ef-7e') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap491bd5ef-7e, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap491bd5ef-7e, col_values=(('external_ids', {'iface-id': '491bd5ef-7e10-49f3-ae6e-3804489ade6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:49:12', 'vm-uuid': 'adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:54 user nova-compute[71711]: INFO os_vif [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:49:12,bridge_name='br-int',has_traffic_filtering=True,id=491bd5ef-7e10-49f3-ae6e-3804489ade6f,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491bd5ef-7e')
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:25:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] No VIF found with MAC fa:16:3e:c0:49:12, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:25:55 user nova-compute[71711]: DEBUG nova.network.neutron [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Updated VIF entry in instance network info cache for port 491bd5ef-7e10-49f3-ae6e-3804489ade6f. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:25:55 user nova-compute[71711]: DEBUG nova.network.neutron [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Updating instance_info_cache with network_info: [{"id": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "address": "fa:16:3e:c0:49:12", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491bd5ef-7e", "ovs_interfaceid": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:25:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-98b7631b-d6f8-4565-84ea-ff61dcd0e486 req-458e9ac2-24ba-4dcc-8ee0-82f50b22fecb service nova] Releasing lock "refresh_cache-adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:25:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-15f4669c-ecf9-4295-aeec-7d0e5e5b60a6 req-9c1acb67-bc6e-42ca-8924-43cb26f824a0 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Received event network-vif-plugged-491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-15f4669c-ecf9-4295-aeec-7d0e5e5b60a6 req-9c1acb67-bc6e-42ca-8924-43cb26f824a0 service nova] Acquiring lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-15f4669c-ecf9-4295-aeec-7d0e5e5b60a6 req-9c1acb67-bc6e-42ca-8924-43cb26f824a0 service nova] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-15f4669c-ecf9-4295-aeec-7d0e5e5b60a6 req-9c1acb67-bc6e-42ca-8924-43cb26f824a0 service nova] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-15f4669c-ecf9-4295-aeec-7d0e5e5b60a6 req-9c1acb67-bc6e-42ca-8924-43cb26f824a0 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] No waiting events found dispatching network-vif-plugged-491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:56 user nova-compute[71711]: WARNING nova.compute.manager [req-15f4669c-ecf9-4295-aeec-7d0e5e5b60a6 req-9c1acb67-bc6e-42ca-8924-43cb26f824a0 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Received unexpected event network-vif-plugged-491bd5ef-7e10-49f3-ae6e-3804489ade6f for instance with vm_state building and task_state spawning.
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-df490edd-35eb-4ee7-8f2e-67ae028b745f req-f7e0112c-05fe-4918-8d16-3451a40dea76 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Received event network-vif-plugged-491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:25:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-df490edd-35eb-4ee7-8f2e-67ae028b745f req-f7e0112c-05fe-4918-8d16-3451a40dea76 service nova] Acquiring lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-df490edd-35eb-4ee7-8f2e-67ae028b745f req-f7e0112c-05fe-4918-8d16-3451a40dea76 service nova] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-df490edd-35eb-4ee7-8f2e-67ae028b745f req-f7e0112c-05fe-4918-8d16-3451a40dea76 service nova] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-df490edd-35eb-4ee7-8f2e-67ae028b745f req-f7e0112c-05fe-4918-8d16-3451a40dea76 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] No waiting events found dispatching network-vif-plugged-491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:25:58 user nova-compute[71711]: WARNING nova.compute.manager [req-df490edd-35eb-4ee7-8f2e-67ae028b745f req-f7e0112c-05fe-4918-8d16-3451a40dea76 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Received unexpected event network-vif-plugged-491bd5ef-7e10-49f3-ae6e-3804489ade6f for instance with vm_state building and task_state spawning.
Apr 12 06:25:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280758.6969135, adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:25:58 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] VM Resumed (Lifecycle Event)
Apr 12 06:25:58 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Instance spawned successfully.
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:25:58 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280758.7142198, adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:25:58 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] VM Started (Lifecycle Event)
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:25:58 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:25:58 user nova-compute[71711]: INFO nova.compute.manager [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Took 6.52 seconds to spawn the instance on the hypervisor.
Apr 12 06:25:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:25:58 user nova-compute[71711]: INFO nova.compute.manager [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Took 7.24 seconds to build instance.
Apr 12 06:25:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fb9a30d1-9174-4dc1-a95c-acbdffb7c357 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.350s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:25:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:25:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:25:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:25:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:26:00 user nova-compute[71711]: INFO nova.compute.claims [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Claim successful on node user
Apr 12 06:26:00 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG nova.network.neutron [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:26:00 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:26:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG nova.policy [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13f5402fd38f40c08c30991ad78b7f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92928c7a0ed463bbd9020808578b263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:26:00 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Creating image(s)
Apr 12 06:26:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "/opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "/opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.241s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk 1073741824" returned: 0 in 0.226s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.390s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.160s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG nova.network.neutron [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Successfully created port: f4d18025-6c85-4429-9b5a-59724be47184 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Cannot resize image /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG nova.objects.instance [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lazy-loading 'migration_context' on Instance uuid 0a0f5f93-3d0f-483c-b467-63b83db9cce1 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Ensure instance console log exists: /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:26:02 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Creating image(s)
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.156s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.214s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG nova.network.neutron [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Successfully updated port: f4d18025-6c85-4429-9b5a-59724be47184 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG nova.compute.manager [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Received event network-changed-f4d18025-6c85-4429-9b5a-59724be47184 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG nova.compute.manager [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Refreshing instance network info cache due to event network-changed-f4d18025-6c85-4429-9b5a-59724be47184. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] Acquiring lock "refresh_cache-0a0f5f93-3d0f-483c-b467-63b83db9cce1" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] Acquired lock "refresh_cache-0a0f5f93-3d0f-483c-b467-63b83db9cce1" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG nova.network.neutron [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Refreshing network info cache for port f4d18025-6c85-4429-9b5a-59724be47184 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk 1073741824" returned: 0 in 0.108s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "refresh_cache-0a0f5f93-3d0f-483c-b467-63b83db9cce1" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG nova.network.neutron [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.185s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:26:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Cannot resize image /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Ensure instance console log exists: /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Start _get_guest_xml network_info=[{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoTzegHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b5758b9-4f7e-4e85-8181-e3dfdd84e624', 'attached_at': '', 'detached_at': '', 'volume_id': 'd96a84d2-2151-4f60-a72b-25e84b80c975', 'serial': 'd96a84d2-2151-4f60-a72b-25e84b80c975'}, 'attachment_id': '14e8b92f-dc90-46e2-bc83-3ab6e56643a2', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:26:03 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 06:26:03 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoTzegHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:26:03 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:26:03 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:26:03 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[663d05bf-a348-4aba-ac93-8398729eb56a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:26:03 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.network.neutron [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef72aef5-0aec-4216-8a7d-2cefb244b8ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975] added
Apr 12 06:26:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-138dab36-31ec-4d34-9f6d-20de57b8bf7c req-c8d21c4e-b6bd-4c53-8f89-4b18e9a3c98d service nova] Releasing lock "refresh_cache-0a0f5f93-3d0f-483c-b467-63b83db9cce1" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.086s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[710c2076-bc61-4684-9fd3-0ae39a9dad73]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquired lock "refresh_cache-0a0f5f93-3d0f-483c-b467-63b83db9cce1" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.network.neutron [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[17530676-fd9d-4f0b-bcab-69afa196fa89]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoTzegHP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.network.neutron [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoTzegHP" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[667e679a-6ce6-4e75-9126-691945b4ec71]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AoTzegHP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff388da-2c99-4edc-a841-59d9830ece5a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6885870-9358-4af7-93f7-7df8e44c619d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d820fa60-57ea-4f9b-b1ae-98e97d64fb4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260]
Apr 12 06:26:03 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260] successful.
Apr 12 06:26:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9209894e-ba12-4d48-979f-6d72195be3da]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfafa97-a652-4529-9198-2d4cdd1b7a55]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:26:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[25834223-ce47-45aa-af62-8cd9e6d81ecc]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoTzegHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.network.neutron [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Updating instance_info_cache with network_info: [{"id": "f4d18025-6c85-4429-9b5a-59724be47184", "address": "fa:16:3e:05:e5:aa", "network": {"id": "3e68bc36-acaf-40c8-983d-8bd288d82224", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1852763740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d92928c7a0ed463bbd9020808578b263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d18025-6c", "ovs_interfaceid": "f4d18025-6c85-4429-9b5a-59724be47184", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Releasing lock "refresh_cache-0a0f5f93-3d0f-483c-b467-63b83db9cce1" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Instance network_info: |[{"id": "f4d18025-6c85-4429-9b5a-59724be47184", "address": "fa:16:3e:05:e5:aa", "network": {"id": "3e68bc36-acaf-40c8-983d-8bd288d82224", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1852763740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d92928c7a0ed463bbd9020808578b263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d18025-6c", "ovs_interfaceid": "f4d18025-6c85-4429-9b5a-59724be47184", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Start _get_guest_xml network_info=[{"id": "f4d18025-6c85-4429-9b5a-59724be47184", "address": "fa:16:3e:05:e5:aa", "network": {"id": "3e68bc36-acaf-40c8-983d-8bd288d82224", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1852763740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d92928c7a0ed463bbd9020808578b263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d18025-6c", "ovs_interfaceid": "f4d18025-6c85-4429-9b5a-59724be47184", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:26:03 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:26:03 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:25:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-431102723',display_name='tempest-VolumesActionsTest-instance-431102723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-431102723',id=14,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d92928c7a0ed463bbd9020808578b263',ramdisk_id='',reservation_id='r-a4wmu02v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-190731565',owner_user_name='tempest-VolumesActionsTest-190731565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:26:01Z,user_data=None,user_id='13f5402fd38f40c08c30991ad78b7f58',uuid=0a0f5f93-3d0f-483c-b467-63b83db9cce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4d18025-6c85-4429-9b5a-59724be47184", "address": "fa:16:3e:05:e5:aa", "network": {"id": "3e68bc36-acaf-40c8-983d-8bd288d82224", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1852763740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d92928c7a0ed463bbd9020808578b263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d18025-6c", "ovs_interfaceid": "f4d18025-6c85-4429-9b5a-59724be47184", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Converting VIF {"id": "f4d18025-6c85-4429-9b5a-59724be47184", "address": "fa:16:3e:05:e5:aa", "network": {"id": "3e68bc36-acaf-40c8-983d-8bd288d82224", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1852763740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d92928c7a0ed463bbd9020808578b263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d18025-6c", "ovs_interfaceid": "f4d18025-6c85-4429-9b5a-59724be47184", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=f4d18025-6c85-4429-9b5a-59724be47184,network=Network(3e68bc36-acaf-40c8-983d-8bd288d82224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d18025-6c') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.objects.instance [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a0f5f93-3d0f-483c-b467-63b83db9cce1 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:26:03 user nova-compute[71711]:   <uuid>0a0f5f93-3d0f-483c-b467-63b83db9cce1</uuid>
Apr 12 06:26:03 user nova-compute[71711]:   <name>instance-0000000e</name>
Apr 12 06:26:03 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:26:03 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:26:03 user nova-compute[71711]:   <metadata>
Apr 12 06:26:03 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:26:03 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:26:03 user nova-compute[71711]:       <nova:name>tempest-VolumesActionsTest-instance-431102723</nova:name>
Apr 12 06:26:03 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:26:03</nova:creationTime>
Apr 12 06:26:03 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:26:03 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:26:03 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:26:03 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:26:03 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:26:03 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:26:03 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:26:03 user nova-compute[71711]:       <nova:owner>
Apr 12 06:26:03 user nova-compute[71711]:         <nova:user uuid="13f5402fd38f40c08c30991ad78b7f58">tempest-VolumesActionsTest-190731565-project-member</nova:user>
Apr 12 06:26:03 user nova-compute[71711]:         <nova:project uuid="d92928c7a0ed463bbd9020808578b263">tempest-VolumesActionsTest-190731565</nova:project>
Apr 12 06:26:03 user nova-compute[71711]:       </nova:owner>
Apr 12 06:26:03 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:26:03 user nova-compute[71711]:       <nova:ports>
Apr 12 06:26:03 user nova-compute[71711]:         <nova:port uuid="f4d18025-6c85-4429-9b5a-59724be47184">
Apr 12 06:26:03 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 12 06:26:03 user nova-compute[71711]:         </nova:port>
Apr 12 06:26:03 user nova-compute[71711]:       </nova:ports>
Apr 12 06:26:03 user nova-compute[71711]:     </nova:instance>
Apr 12 06:26:03 user nova-compute[71711]:   </metadata>
Apr 12 06:26:03 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:26:03 user nova-compute[71711]:     <system>
Apr 12 06:26:03 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:26:03 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:26:03 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:26:03 user nova-compute[71711]:       <entry name="serial">0a0f5f93-3d0f-483c-b467-63b83db9cce1</entry>
Apr 12 06:26:03 user nova-compute[71711]:       <entry name="uuid">0a0f5f93-3d0f-483c-b467-63b83db9cce1</entry>
Apr 12 06:26:03 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:26:03 user nova-compute[71711]:     </system>
Apr 12 06:26:03 user nova-compute[71711]:   </sysinfo>
Apr 12 06:26:03 user nova-compute[71711]:   <os>
Apr 12 06:26:03 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:26:03 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:26:03 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:26:03 user nova-compute[71711]:   </os>
Apr 12 06:26:03 user nova-compute[71711]:   <features>
Apr 12 06:26:03 user nova-compute[71711]:     <acpi/>
Apr 12 06:26:03 user nova-compute[71711]:     <apic/>
Apr 12 06:26:03 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:26:03 user nova-compute[71711]:   </features>
Apr 12 06:26:03 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:26:03 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:26:03 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:26:03 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:26:03 user nova-compute[71711]:   </clock>
Apr 12 06:26:03 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:26:03 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:26:03 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:26:03 user nova-compute[71711]:   </cpu>
Apr 12 06:26:03 user nova-compute[71711]:   <devices>
Apr 12 06:26:03 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:26:03 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:26:03 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk"/>
Apr 12 06:26:03 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:26:03 user nova-compute[71711]:     </disk>
Apr 12 06:26:03 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:26:03 user nova-compute[71711]:       <mac address="fa:16:3e:05:e5:aa"/>
Apr 12 06:26:03 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:26:03 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:26:03 user nova-compute[71711]:       <target dev="tapf4d18025-6c"/>
Apr 12 06:26:03 user nova-compute[71711]:     </interface>
Apr 12 06:26:03 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:26:03 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/console.log" append="off"/>
Apr 12 06:26:03 user nova-compute[71711]:     </serial>
Apr 12 06:26:03 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:26:03 user nova-compute[71711]:     <video>
Apr 12 06:26:03 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:26:03 user nova-compute[71711]:     </video>
Apr 12 06:26:03 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:26:03 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:26:03 user nova-compute[71711]:     </rng>
Apr 12 06:26:03 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:26:03 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:26:03 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:26:03 user nova-compute[71711]:     </memballoon>
Apr 12 06:26:03 user nova-compute[71711]:   </devices>
Apr 12 06:26:03 user nova-compute[71711]: </domain>
Apr 12 06:26:03 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:25:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-431102723',display_name='tempest-VolumesActionsTest-instance-431102723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-431102723',id=14,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d92928c7a0ed463bbd9020808578b263',ramdisk_id='',reservation_id='r-a4wmu02v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-190731565',owner_user_name='tempest-VolumesActionsTest-190731565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:26:01Z,user_data=None,user_id='13f5402fd38f40c08c30991ad78b7f58',uuid=0a0f5f93-3d0f-483c-b467-63b83db9cce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4d18025-6c85-4429-9b5a-59724be47184", "address": "fa:16:3e:05:e5:aa", "network": {"id": "3e68bc36-acaf-40c8-983d-8bd288d82224", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1852763740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d92928c7a0ed463bbd9020808578b263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d18025-6c", "ovs_interfaceid": "f4d18025-6c85-4429-9b5a-59724be47184", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Converting VIF {"id": "f4d18025-6c85-4429-9b5a-59724be47184", "address": "fa:16:3e:05:e5:aa", "network": {"id": "3e68bc36-acaf-40c8-983d-8bd288d82224", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1852763740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d92928c7a0ed463bbd9020808578b263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d18025-6c", "ovs_interfaceid": "f4d18025-6c85-4429-9b5a-59724be47184", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=f4d18025-6c85-4429-9b5a-59724be47184,network=Network(3e68bc36-acaf-40c8-983d-8bd288d82224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d18025-6c') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG os_vif [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=f4d18025-6c85-4429-9b5a-59724be47184,network=Network(3e68bc36-acaf-40c8-983d-8bd288d82224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d18025-6c') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4d18025-6c, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4d18025-6c, col_values=(('external_ids', {'iface-id': 'f4d18025-6c85-4429-9b5a-59724be47184', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:e5:aa', 'vm-uuid': '0a0f5f93-3d0f-483c-b467-63b83db9cce1'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:03 user nova-compute[71711]: INFO os_vif [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=f4d18025-6c85-4429-9b5a-59724be47184,network=Network(3e68bc36-acaf-40c8-983d-8bd288d82224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d18025-6c')
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:26:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] No VIF found with MAC fa:16:3e:05:e5:aa, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '23830653063646534', 'path': '/dev/sdf'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830653063646534', 'path': '/dev/sdf'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1807692588',display_name='tempest-ServerActionsTestJSON-server-1279128249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1807692588',id=4,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-hktvsdi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=5b5758b9-4f7e-4e85-8181-e3dfdd84e624,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:26:04 user nova-compute[71711]:   <uuid>5b5758b9-4f7e-4e85-8181-e3dfdd84e624</uuid>
Apr 12 06:26:04 user nova-compute[71711]:   <name>instance-00000004</name>
Apr 12 06:26:04 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:26:04 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:26:04 user nova-compute[71711]:   <metadata>
Apr 12 06:26:04 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:26:04 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:26:04 user nova-compute[71711]:       <nova:name>tempest-ServerActionsTestJSON-server-1279128249</nova:name>
Apr 12 06:26:04 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:26:03</nova:creationTime>
Apr 12 06:26:04 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:26:04 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:26:04 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:26:04 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:26:04 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:26:04 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:26:04 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:26:04 user nova-compute[71711]:       <nova:owner>
Apr 12 06:26:04 user nova-compute[71711]:         <nova:user uuid="ad316acdc89947bbba60c75e9a24d7e9">tempest-ServerActionsTestJSON-752347644-project-member</nova:user>
Apr 12 06:26:04 user nova-compute[71711]:         <nova:project uuid="54fd87c4105246c1ac1bdf424c83b7aa">tempest-ServerActionsTestJSON-752347644</nova:project>
Apr 12 06:26:04 user nova-compute[71711]:       </nova:owner>
Apr 12 06:26:04 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:26:04 user nova-compute[71711]:       <nova:ports>
Apr 12 06:26:04 user nova-compute[71711]:         <nova:port uuid="8fba3fe8-62b6-46be-a025-3ec5a629ee80">
Apr 12 06:26:04 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 06:26:04 user nova-compute[71711]:         </nova:port>
Apr 12 06:26:04 user nova-compute[71711]:       </nova:ports>
Apr 12 06:26:04 user nova-compute[71711]:     </nova:instance>
Apr 12 06:26:04 user nova-compute[71711]:   </metadata>
Apr 12 06:26:04 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:26:04 user nova-compute[71711]:     <system>
Apr 12 06:26:04 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:26:04 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:26:04 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:26:04 user nova-compute[71711]:       <entry name="serial">5b5758b9-4f7e-4e85-8181-e3dfdd84e624</entry>
Apr 12 06:26:04 user nova-compute[71711]:       <entry name="uuid">5b5758b9-4f7e-4e85-8181-e3dfdd84e624</entry>
Apr 12 06:26:04 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:26:04 user nova-compute[71711]:     </system>
Apr 12 06:26:04 user nova-compute[71711]:   </sysinfo>
Apr 12 06:26:04 user nova-compute[71711]:   <os>
Apr 12 06:26:04 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:26:04 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:26:04 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:26:04 user nova-compute[71711]:   </os>
Apr 12 06:26:04 user nova-compute[71711]:   <features>
Apr 12 06:26:04 user nova-compute[71711]:     <acpi/>
Apr 12 06:26:04 user nova-compute[71711]:     <apic/>
Apr 12 06:26:04 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:26:04 user nova-compute[71711]:   </features>
Apr 12 06:26:04 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:26:04 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:26:04 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:26:04 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:26:04 user nova-compute[71711]:   </clock>
Apr 12 06:26:04 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:26:04 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:26:04 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:26:04 user nova-compute[71711]:   </cpu>
Apr 12 06:26:04 user nova-compute[71711]:   <devices>
Apr 12 06:26:04 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:26:04 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:26:04 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk"/>
Apr 12 06:26:04 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:26:04 user nova-compute[71711]:     </disk>
Apr 12 06:26:04 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:26:04 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:26:04 user nova-compute[71711]:       <source dev="/dev/sdf"/>
Apr 12 06:26:04 user nova-compute[71711]:       <target dev="vdb" bus="virtio"/>
Apr 12 06:26:04 user nova-compute[71711]:       <serial>d96a84d2-2151-4f60-a72b-25e84b80c975</serial>
Apr 12 06:26:04 user nova-compute[71711]:     </disk>
Apr 12 06:26:04 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:26:04 user nova-compute[71711]:       <mac address="fa:16:3e:7c:bb:4d"/>
Apr 12 06:26:04 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:26:04 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:26:04 user nova-compute[71711]:       <target dev="tap8fba3fe8-62"/>
Apr 12 06:26:04 user nova-compute[71711]:     </interface>
Apr 12 06:26:04 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:26:04 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/console.log" append="off"/>
Apr 12 06:26:04 user nova-compute[71711]:     </serial>
Apr 12 06:26:04 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:26:04 user nova-compute[71711]:     <video>
Apr 12 06:26:04 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:26:04 user nova-compute[71711]:     </video>
Apr 12 06:26:04 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:26:04 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:26:04 user nova-compute[71711]:     </rng>
Apr 12 06:26:04 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:26:04 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:26:04 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:26:04 user nova-compute[71711]:     </memballoon>
Apr 12 06:26:04 user nova-compute[71711]:   </devices>
Apr 12 06:26:04 user nova-compute[71711]: </domain>
Apr 12 06:26:04 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1807692588',display_name='tempest-ServerActionsTestJSON-server-1279128249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1807692588',id=4,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-hktvsdi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:25:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=5b5758b9-4f7e-4e85-8181-e3dfdd84e624,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG os_vif [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fba3fe8-62, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fba3fe8-62, col_values=(('external_ids', {'iface-id': '8fba3fe8-62b6-46be-a025-3ec5a629ee80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:bb:4d', 'vm-uuid': '5b5758b9-4f7e-4e85-8181-e3dfdd84e624'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:04 user nova-compute[71711]: INFO os_vif [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62')
Apr 12 06:26:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No VIF found with MAC fa:16:3e:7c:bb:4d, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:26:04 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280749.8414323, 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:26:04 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] VM Stopped (Lifecycle Event)
Apr 12 06:26:04 user nova-compute[71711]: DEBUG nova.compute.manager [None req-0e02c8bf-be59-4065-aaae-bc986a31887f None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:26:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:06 user nova-compute[71711]: DEBUG nova.compute.manager [req-d94474e1-c5f3-4486-924c-b02f2de7ed81 req-f208cda1-5283-4e3c-b96b-a1699b042d69 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Received event network-vif-plugged-f4d18025-6c85-4429-9b5a-59724be47184 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:26:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d94474e1-c5f3-4486-924c-b02f2de7ed81 req-f208cda1-5283-4e3c-b96b-a1699b042d69 service nova] Acquiring lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d94474e1-c5f3-4486-924c-b02f2de7ed81 req-f208cda1-5283-4e3c-b96b-a1699b042d69 service nova] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d94474e1-c5f3-4486-924c-b02f2de7ed81 req-f208cda1-5283-4e3c-b96b-a1699b042d69 service nova] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:06 user nova-compute[71711]: DEBUG nova.compute.manager [req-d94474e1-c5f3-4486-924c-b02f2de7ed81 req-f208cda1-5283-4e3c-b96b-a1699b042d69 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] No waiting events found dispatching network-vif-plugged-f4d18025-6c85-4429-9b5a-59724be47184 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:26:06 user nova-compute[71711]: WARNING nova.compute.manager [req-d94474e1-c5f3-4486-924c-b02f2de7ed81 req-f208cda1-5283-4e3c-b96b-a1699b042d69 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Received unexpected event network-vif-plugged-f4d18025-6c85-4429-9b5a-59724be47184 for instance with vm_state building and task_state spawning.
Apr 12 06:26:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Received event network-vif-plugged-f4d18025-6c85-4429-9b5a-59724be47184 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Acquiring lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] No waiting events found dispatching network-vif-plugged-f4d18025-6c85-4429-9b5a-59724be47184 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:26:08 user nova-compute[71711]: WARNING nova.compute.manager [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Received unexpected event network-vif-plugged-f4d18025-6c85-4429-9b5a-59724be47184 for instance with vm_state building and task_state spawning.
Apr 12 06:26:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:26:08 user nova-compute[71711]: WARNING nova.compute.manager [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state active and task_state rebuild_spawning.
Apr 12 06:26:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:26:08 user nova-compute[71711]: WARNING nova.compute.manager [req-bf70c280-d710-4718-be1e-ac70caa9b92e req-81839701-a235-4351-8a1a-5c5dfa1a00e7 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state active and task_state rebuild_spawning.
Apr 12 06:26:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280769.2408633, 0a0f5f93-3d0f-483c-b467-63b83db9cce1 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:26:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] VM Resumed (Lifecycle Event)
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:26:09 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Instance spawned successfully.
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:26:09 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance spawned successfully.
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280769.2411606, 0a0f5f93-3d0f-483c-b467-63b83db9cce1 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:26:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] VM Started (Lifecycle Event)
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:26:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Took 8.54 seconds to spawn the instance on the hypervisor.
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:26:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280769.2457416, 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:26:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] VM Resumed (Lifecycle Event)
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:26:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280769.2489998, 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:26:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] VM Started (Lifecycle Event)
Apr 12 06:26:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Took 9.49 seconds to build instance.
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-bdbc2d32-effc-4040-b916-1c037f8cd24d tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.588s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71711) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca72bde3-c915-40d5-bf3e-4ef5a9d54305 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.099s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:26:23 user nova-compute[71711]: INFO nova.compute.claims [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Claim successful on node user
Apr 12 06:26:23 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG nova.network.neutron [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:26:23 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:26:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG nova.policy [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:26:23 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Creating image(s)
Apr 12 06:26:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "/opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "/opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.157s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.184s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk 1073741824" returned: 0 in 0.319s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.512s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.212s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:24 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:26:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:25 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Cannot resize image /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:26:25 user nova-compute[71711]: DEBUG nova.objects.instance [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'migration_context' on Instance uuid 0a6c87b7-75d7-429e-9f7b-e8a959f1791f {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:26:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:26:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Ensure instance console log exists: /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:26:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:25 user nova-compute[71711]: DEBUG nova.network.neutron [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Successfully created port: c9e9de0e-798c-49fb-aeb3-30eccc267206 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.network.neutron [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Successfully updated port: c9e9de0e-798c-49fb-aeb3-30eccc267206 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquired lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.network.neutron [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.compute.manager [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Received event network-changed-c9e9de0e-798c-49fb-aeb3-30eccc267206 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.compute.manager [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Refreshing instance network info cache due to event network-changed-c9e9de0e-798c-49fb-aeb3-30eccc267206. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] Acquiring lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.network.neutron [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.network.neutron [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Updating instance_info_cache with network_info: [{"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Releasing lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Instance network_info: |[{"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] Acquired lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.network.neutron [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Refreshing network info cache for port c9e9de0e-798c-49fb-aeb3-30eccc267206 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Start _get_guest_xml network_info=[{"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:26:26 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:26:26 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:26:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-996712143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-996712143',id=15,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-ke6c9y5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:26:24Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=0a6c87b7-75d7-429e-9f7b-e8a959f1791f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:34:34,bridge_name='br-int',has_traffic_filtering=True,id=c9e9de0e-798c-49fb-aeb3-30eccc267206,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e9de0e-79') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.objects.instance [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a6c87b7-75d7-429e-9f7b-e8a959f1791f {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:26:26 user nova-compute[71711]:   <uuid>0a6c87b7-75d7-429e-9f7b-e8a959f1791f</uuid>
Apr 12 06:26:26 user nova-compute[71711]:   <name>instance-0000000f</name>
Apr 12 06:26:26 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:26:26 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:26:26 user nova-compute[71711]:   <metadata>
Apr 12 06:26:26 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:26:26 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:26:26 user nova-compute[71711]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-996712143</nova:name>
Apr 12 06:26:26 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:26:26</nova:creationTime>
Apr 12 06:26:26 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:26:26 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:26:26 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:26:26 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:26:26 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:26:26 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:26:26 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:26:26 user nova-compute[71711]:       <nova:owner>
Apr 12 06:26:26 user nova-compute[71711]:         <nova:user uuid="2e5e4455358643b8830ce8c96aad5aad">tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member</nova:user>
Apr 12 06:26:26 user nova-compute[71711]:         <nova:project uuid="0ecae91e53ee4d70a8dc24c7febc2a0e">tempest-ServerBootFromVolumeStableRescueTest-2063268056</nova:project>
Apr 12 06:26:26 user nova-compute[71711]:       </nova:owner>
Apr 12 06:26:26 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:26:26 user nova-compute[71711]:       <nova:ports>
Apr 12 06:26:26 user nova-compute[71711]:         <nova:port uuid="c9e9de0e-798c-49fb-aeb3-30eccc267206">
Apr 12 06:26:26 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 06:26:26 user nova-compute[71711]:         </nova:port>
Apr 12 06:26:26 user nova-compute[71711]:       </nova:ports>
Apr 12 06:26:26 user nova-compute[71711]:     </nova:instance>
Apr 12 06:26:26 user nova-compute[71711]:   </metadata>
Apr 12 06:26:26 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:26:26 user nova-compute[71711]:     <system>
Apr 12 06:26:26 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:26:26 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:26:26 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:26:26 user nova-compute[71711]:       <entry name="serial">0a6c87b7-75d7-429e-9f7b-e8a959f1791f</entry>
Apr 12 06:26:26 user nova-compute[71711]:       <entry name="uuid">0a6c87b7-75d7-429e-9f7b-e8a959f1791f</entry>
Apr 12 06:26:26 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:26:26 user nova-compute[71711]:     </system>
Apr 12 06:26:26 user nova-compute[71711]:   </sysinfo>
Apr 12 06:26:26 user nova-compute[71711]:   <os>
Apr 12 06:26:26 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:26:26 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:26:26 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:26:26 user nova-compute[71711]:   </os>
Apr 12 06:26:26 user nova-compute[71711]:   <features>
Apr 12 06:26:26 user nova-compute[71711]:     <acpi/>
Apr 12 06:26:26 user nova-compute[71711]:     <apic/>
Apr 12 06:26:26 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:26:26 user nova-compute[71711]:   </features>
Apr 12 06:26:26 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:26:26 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:26:26 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:26:26 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:26:26 user nova-compute[71711]:   </clock>
Apr 12 06:26:26 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:26:26 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:26:26 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:26:26 user nova-compute[71711]:   </cpu>
Apr 12 06:26:26 user nova-compute[71711]:   <devices>
Apr 12 06:26:26 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:26:26 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:26:26 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk"/>
Apr 12 06:26:26 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:26:26 user nova-compute[71711]:     </disk>
Apr 12 06:26:26 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:26:26 user nova-compute[71711]:       <mac address="fa:16:3e:40:34:34"/>
Apr 12 06:26:26 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:26:26 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:26:26 user nova-compute[71711]:       <target dev="tapc9e9de0e-79"/>
Apr 12 06:26:26 user nova-compute[71711]:     </interface>
Apr 12 06:26:26 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:26:26 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/console.log" append="off"/>
Apr 12 06:26:26 user nova-compute[71711]:     </serial>
Apr 12 06:26:26 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:26:26 user nova-compute[71711]:     <video>
Apr 12 06:26:26 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:26:26 user nova-compute[71711]:     </video>
Apr 12 06:26:26 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:26:26 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:26:26 user nova-compute[71711]:     </rng>
Apr 12 06:26:26 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:26:26 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:26:26 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:26:26 user nova-compute[71711]:     </memballoon>
Apr 12 06:26:26 user nova-compute[71711]:   </devices>
Apr 12 06:26:26 user nova-compute[71711]: </domain>
Apr 12 06:26:26 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:26:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-996712143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-996712143',id=15,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-ke6c9y5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:26:24Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=0a6c87b7-75d7-429e-9f7b-e8a959f1791f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:34:34,bridge_name='br-int',has_traffic_filtering=True,id=c9e9de0e-798c-49fb-aeb3-30eccc267206,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e9de0e-79') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG os_vif [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:34:34,bridge_name='br-int',has_traffic_filtering=True,id=c9e9de0e-798c-49fb-aeb3-30eccc267206,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e9de0e-79') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9e9de0e-79, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9e9de0e-79, col_values=(('external_ids', {'iface-id': 'c9e9de0e-798c-49fb-aeb3-30eccc267206', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:34:34', 'vm-uuid': '0a6c87b7-75d7-429e-9f7b-e8a959f1791f'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:26 user nova-compute[71711]: INFO os_vif [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:34:34,bridge_name='br-int',has_traffic_filtering=True,id=c9e9de0e-798c-49fb-aeb3-30eccc267206,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e9de0e-79')
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:26:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No VIF found with MAC fa:16:3e:40:34:34, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:26:27 user nova-compute[71711]: DEBUG nova.network.neutron [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Updated VIF entry in instance network info cache for port c9e9de0e-798c-49fb-aeb3-30eccc267206. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:26:27 user nova-compute[71711]: DEBUG nova.network.neutron [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Updating instance_info_cache with network_info: [{"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:26:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-46aec1b8-39a5-4bbc-a012-ff1716dcd125 req-8e1e63c2-8681-4365-b98f-2d7616d536f5 service nova] Releasing lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:26:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-af418bdc-fed0-4e04-ae53-468386250b96 req-624262d7-b971-42c7-8caa-76880bc2cc14 service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Received event network-vif-plugged-c9e9de0e-798c-49fb-aeb3-30eccc267206 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:26:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-af418bdc-fed0-4e04-ae53-468386250b96 req-624262d7-b971-42c7-8caa-76880bc2cc14 service nova] Acquiring lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-af418bdc-fed0-4e04-ae53-468386250b96 req-624262d7-b971-42c7-8caa-76880bc2cc14 service nova] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-af418bdc-fed0-4e04-ae53-468386250b96 req-624262d7-b971-42c7-8caa-76880bc2cc14 service nova] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-af418bdc-fed0-4e04-ae53-468386250b96 req-624262d7-b971-42c7-8caa-76880bc2cc14 service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] No waiting events found dispatching network-vif-plugged-c9e9de0e-798c-49fb-aeb3-30eccc267206 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:26:28 user nova-compute[71711]: WARNING nova.compute.manager [req-af418bdc-fed0-4e04-ae53-468386250b96 req-624262d7-b971-42c7-8caa-76880bc2cc14 service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Received unexpected event network-vif-plugged-c9e9de0e-798c-49fb-aeb3-30eccc267206 for instance with vm_state building and task_state spawning.
Apr 12 06:26:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280790.4653533, 0a6c87b7-75d7-429e-9f7b-e8a959f1791f => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:26:30 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] VM Resumed (Lifecycle Event)
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:26:30 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Instance spawned successfully.
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:26:30 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280790.4672375, 0a6c87b7-75d7-429e-9f7b-e8a959f1791f => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:26:30 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] VM Started (Lifecycle Event)
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:26:30 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:26:30 user nova-compute[71711]: INFO nova.compute.manager [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Took 6.73 seconds to spawn the instance on the hypervisor.
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.compute.manager [req-1557abcd-7de8-4c7f-963b-374b3467d544 req-1e7aaa5b-b5eb-4400-9bae-b21de62c1fbc service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Received event network-vif-plugged-c9e9de0e-798c-49fb-aeb3-30eccc267206 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1557abcd-7de8-4c7f-963b-374b3467d544 req-1e7aaa5b-b5eb-4400-9bae-b21de62c1fbc service nova] Acquiring lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1557abcd-7de8-4c7f-963b-374b3467d544 req-1e7aaa5b-b5eb-4400-9bae-b21de62c1fbc service nova] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1557abcd-7de8-4c7f-963b-374b3467d544 req-1e7aaa5b-b5eb-4400-9bae-b21de62c1fbc service nova] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:30 user nova-compute[71711]: DEBUG nova.compute.manager [req-1557abcd-7de8-4c7f-963b-374b3467d544 req-1e7aaa5b-b5eb-4400-9bae-b21de62c1fbc service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] No waiting events found dispatching network-vif-plugged-c9e9de0e-798c-49fb-aeb3-30eccc267206 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:26:30 user nova-compute[71711]: WARNING nova.compute.manager [req-1557abcd-7de8-4c7f-963b-374b3467d544 req-1e7aaa5b-b5eb-4400-9bae-b21de62c1fbc service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Received unexpected event network-vif-plugged-c9e9de0e-798c-49fb-aeb3-30eccc267206 for instance with vm_state building and task_state spawning.
Apr 12 06:26:30 user nova-compute[71711]: INFO nova.compute.manager [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Took 7.49 seconds to build instance.
Apr 12 06:26:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f008742-8f16-4745-b296-5427fbcebb57 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.589s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:42 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:26:42 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:26:42 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:26:42 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:26:42 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-46b32f3f-86c4-450a-a710-7d0c05ea4097" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-46b32f3f-86c4-450a-a710-7d0c05ea4097" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid 46b32f3f-86c4-450a-a710-7d0c05ea4097 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Updating instance_info_cache with network_info: [{"id": "33f085d7-b843-4c48-8379-a5c2690a4231", "address": "fa:16:3e:4e:28:c3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f085d7-b8", "ovs_interfaceid": "33f085d7-b843-4c48-8379-a5c2690a4231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-46b32f3f-86c4-450a-a710-7d0c05ea4097" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:26:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:26:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:44 user nova-compute[71711]: INFO nova.compute.manager [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Unshelving
Apr 12 06:26:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:45 user nova-compute[71711]: INFO nova.virt.block_device [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Booting with volume d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a at /dev/vda
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG os_brick.utils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.034s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4fdb3b-7f1b-4db1-aaad-a0fe75c4111b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4041f4f6-494b-4150-8bce-13d1b25bd421]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d61490-1282-4e78-bc84-1103c98f8e50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5f2c20-5be4-4365-9c57-79a50825e75d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:26:45 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb90060-f6f1-4987-8c5e-ae09b79c2276]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG os_brick.utils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updating existing volume attachment record: 0d6eff84-346f-4147-ab6f-3d248b7d3f04 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:26:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:26:48 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:26:48 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7670MB free_disk=26.393543243408203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7dee97a4-9497-43c2-a688-7bedd1441885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance a528e600-7358-4b92-9b71-12759f405b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance d15be760-180e-4335-b670-ecd8873609b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:50 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lazy-loading 'pci_requests' on Instance uuid 7141c80d-34a9-40cc-a792-b01ffd9155b6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:26:50 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lazy-loading 'numa_topology' on Instance uuid 7141c80d-34a9-40cc-a792-b01ffd9155b6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:26:50 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:26:50 user nova-compute[71711]: INFO nova.compute.claims [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Claim successful on node user
Apr 12 06:26:50 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:26:50 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:26:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:50 user nova-compute[71711]: INFO nova.network.neutron [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updating port f2b23249-b032-47f5-973e-922f210b40b2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquired lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.compute.manager [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-changed-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.compute.manager [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Refreshing instance network info cache due to event network-changed-f2b23249-b032-47f5-973e-922f210b40b2. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] Acquiring lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updating instance_info_cache with network_info: [{"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Releasing lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:26:51 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Creating image(s)
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Ensure instance console log exists: /opt/stack/data/nova/instances/7141c80d-34a9-40cc-a792-b01ffd9155b6/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Start _get_guest_xml network_info=[{"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcOxDrPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7141c80d-34a9-40cc-a792-b01ffd9155b6', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'serial': 'd3ef3a9b-2394-48ed-a2a6-e85ab6076c8a'}, 'attachment_id': '0d6eff84-346f-4147-ab6f-3d248b7d3f04', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] Acquired lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.network.neutron [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Refreshing network info cache for port f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:26:51 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:26:51 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7141c80d-34a9-40cc-a792-b01ffd9155b6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcOxDrPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:26:51 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:26:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:26:51 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:26:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:26:51 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6aa8fe3-838a-41f7-80ea-e50655df3696]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:26:51 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a5f886-e5ae-4760-a534-998355564444]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a] added
Apr 12 06:26:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea50ba0-7551-4a8b-8949-0ba328772628]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bff948-c6cf-4d0b-9a77-1856b9ffb913]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bcOxDrPR {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bcOxDrPR" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b07e1d-6899-459d-9204-40841bf77bac]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bcOxDrPR'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d09b56e-620e-4d0e-96aa-df17c6bad5e1]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5f6d16-2c27-4024-bd18-da5f419fa76e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:26:51 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:26:51 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:26:51 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:26:51 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:26:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:26:51 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:26:51 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:26:51 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:26:51 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:26:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:26:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fce376-e05f-45ba-80b6-c399167eacb6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260]
Apr 12 06:26:52 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260] successful.
Apr 12 06:26:52 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2792673-eaf7-4ef0-b8d4-e87550b96e8d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8153476b-c83f-48b7-ac7e-71f794e5351f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:26:52 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:26:52 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:26:52 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:26:52 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:26:52 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:26:52 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:26:52 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:26:52 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:26:52 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:26:52 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:26:52 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:26:52 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad68bfdc-771e-48b8-9195-6051c4049ffc]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcOxDrPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG nova.network.neutron [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updated VIF entry in instance network info cache for port f2b23249-b032-47f5-973e-922f210b40b2. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG nova.network.neutron [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updating instance_info_cache with network_info: [{"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:26:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-dc902f96-05d4-4744-b56c-a0eaf13a4ec6 req-7a1bf161-dd37-4aad-bb56-2503e1492f2d service nova] Releasing lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26434393862343066', 'path': '/dev/sdg'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434393862343066', 'path': '/dev/sdg'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:23:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1182120878',display_name='tempest-TestShelveInstance-server-1182120878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1182120878',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1634672150',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7742afa38eb46818efaf3b811c417ba',ramdisk_id='',reservation_id='r-jkmurz28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-735091148',owner_user_name='tempest-TestShelveInstance-735091148-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:26:45Z,user_data=None,user_id='9ed3a446901644b6a622afb3166f08dc',uuid=7141c80d-34a9-40cc-a792-b01ffd9155b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Converting VIF {"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lazy-loading 'pci_devices' on Instance uuid 7141c80d-34a9-40cc-a792-b01ffd9155b6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:26:53 user nova-compute[71711]:   <uuid>7141c80d-34a9-40cc-a792-b01ffd9155b6</uuid>
Apr 12 06:26:53 user nova-compute[71711]:   <name>instance-0000000a</name>
Apr 12 06:26:53 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:26:53 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:26:53 user nova-compute[71711]:   <metadata>
Apr 12 06:26:53 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:26:53 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:26:53 user nova-compute[71711]:       <nova:name>tempest-TestShelveInstance-server-1182120878</nova:name>
Apr 12 06:26:53 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:26:51</nova:creationTime>
Apr 12 06:26:53 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:26:53 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:26:53 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:26:53 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:26:53 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:26:53 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:26:53 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:26:53 user nova-compute[71711]:       <nova:owner>
Apr 12 06:26:53 user nova-compute[71711]:         <nova:user uuid="9ed3a446901644b6a622afb3166f08dc">tempest-TestShelveInstance-735091148-project-member</nova:user>
Apr 12 06:26:53 user nova-compute[71711]:         <nova:project uuid="c7742afa38eb46818efaf3b811c417ba">tempest-TestShelveInstance-735091148</nova:project>
Apr 12 06:26:53 user nova-compute[71711]:       </nova:owner>
Apr 12 06:26:53 user nova-compute[71711]:       <nova:ports>
Apr 12 06:26:53 user nova-compute[71711]:         <nova:port uuid="f2b23249-b032-47f5-973e-922f210b40b2">
Apr 12 06:26:53 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 06:26:53 user nova-compute[71711]:         </nova:port>
Apr 12 06:26:53 user nova-compute[71711]:       </nova:ports>
Apr 12 06:26:53 user nova-compute[71711]:     </nova:instance>
Apr 12 06:26:53 user nova-compute[71711]:   </metadata>
Apr 12 06:26:53 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:26:53 user nova-compute[71711]:     <system>
Apr 12 06:26:53 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:26:53 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:26:53 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:26:53 user nova-compute[71711]:       <entry name="serial">7141c80d-34a9-40cc-a792-b01ffd9155b6</entry>
Apr 12 06:26:53 user nova-compute[71711]:       <entry name="uuid">7141c80d-34a9-40cc-a792-b01ffd9155b6</entry>
Apr 12 06:26:53 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:26:53 user nova-compute[71711]:     </system>
Apr 12 06:26:53 user nova-compute[71711]:   </sysinfo>
Apr 12 06:26:53 user nova-compute[71711]:   <os>
Apr 12 06:26:53 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:26:53 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:26:53 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:26:53 user nova-compute[71711]:   </os>
Apr 12 06:26:53 user nova-compute[71711]:   <features>
Apr 12 06:26:53 user nova-compute[71711]:     <acpi/>
Apr 12 06:26:53 user nova-compute[71711]:     <apic/>
Apr 12 06:26:53 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:26:53 user nova-compute[71711]:   </features>
Apr 12 06:26:53 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:26:53 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:26:53 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:26:53 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:26:53 user nova-compute[71711]:   </clock>
Apr 12 06:26:53 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:26:53 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:26:53 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:26:53 user nova-compute[71711]:   </cpu>
Apr 12 06:26:53 user nova-compute[71711]:   <devices>
Apr 12 06:26:53 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:26:53 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:26:53 user nova-compute[71711]:       <source dev="/dev/sdg"/>
Apr 12 06:26:53 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:26:53 user nova-compute[71711]:       <serial>d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a</serial>
Apr 12 06:26:53 user nova-compute[71711]:     </disk>
Apr 12 06:26:53 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:26:53 user nova-compute[71711]:       <mac address="fa:16:3e:29:02:01"/>
Apr 12 06:26:53 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:26:53 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:26:53 user nova-compute[71711]:       <target dev="tapf2b23249-b0"/>
Apr 12 06:26:53 user nova-compute[71711]:     </interface>
Apr 12 06:26:53 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:26:53 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/7141c80d-34a9-40cc-a792-b01ffd9155b6/console.log" append="off"/>
Apr 12 06:26:53 user nova-compute[71711]:     </serial>
Apr 12 06:26:53 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:26:53 user nova-compute[71711]:     <video>
Apr 12 06:26:53 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:26:53 user nova-compute[71711]:     </video>
Apr 12 06:26:53 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:26:53 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:26:53 user nova-compute[71711]:     </rng>
Apr 12 06:26:53 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:26:53 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:26:53 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:26:53 user nova-compute[71711]:     </memballoon>
Apr 12 06:26:53 user nova-compute[71711]:   </devices>
Apr 12 06:26:53 user nova-compute[71711]: </domain>
Apr 12 06:26:53 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:23:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1182120878',display_name='tempest-TestShelveInstance-server-1182120878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1182120878',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1634672150',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c7742afa38eb46818efaf3b811c417ba',ramdisk_id='',reservation_id='r-jkmurz28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-735091148',owner_user_name='tempest-TestShelveInstance-735091148-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:26:45Z,user_data=None,user_id='9ed3a446901644b6a622afb3166f08dc',uuid=7141c80d-34a9-40cc-a792-b01ffd9155b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Converting VIF {"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG os_vif [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2b23249-b0, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2b23249-b0, col_values=(('external_ids', {'iface-id': 'f2b23249-b032-47f5-973e-922f210b40b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:02:01', 'vm-uuid': '7141c80d-34a9-40cc-a792-b01ffd9155b6'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:53 user nova-compute[71711]: INFO os_vif [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0')
Apr 12 06:26:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] No VIF found with MAC fa:16:3e:29:02:01, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:26:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "d78558e6-437e-44dd-b6b4-123ed3447094" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "d78558e6-437e-44dd-b6b4-123ed3447094" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:26:54 user nova-compute[71711]: INFO nova.compute.claims [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Claim successful on node user
Apr 12 06:26:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-b2efd709-cfa3-444a-b71f-57106dcb7761 req-f8598657-2b09-4219-9a47-722bdb23e1c8 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b2efd709-cfa3-444a-b71f-57106dcb7761 req-f8598657-2b09-4219-9a47-722bdb23e1c8 service nova] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b2efd709-cfa3-444a-b71f-57106dcb7761 req-f8598657-2b09-4219-9a47-722bdb23e1c8 service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b2efd709-cfa3-444a-b71f-57106dcb7761 req-f8598657-2b09-4219-9a47-722bdb23e1c8 service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-b2efd709-cfa3-444a-b71f-57106dcb7761 req-f8598657-2b09-4219-9a47-722bdb23e1c8 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] No waiting events found dispatching network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:26:54 user nova-compute[71711]: WARNING nova.compute.manager [req-b2efd709-cfa3-444a-b71f-57106dcb7761 req-f8598657-2b09-4219-9a47-722bdb23e1c8 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received unexpected event network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 06:26:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:26:54 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:26:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG nova.policy [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd682efe6338b4989beb714cce25e8e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b656fa0bf05484889563c50ccc9a7e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:26:54 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Creating image(s)
Apr 12 06:26:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "/opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "/opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "/opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk 1073741824" returned: 0 in 0.054s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Successfully created port: b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Cannot resize image /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lazy-loading 'migration_context' on Instance uuid d78558e6-437e-44dd-b6b4-123ed3447094 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Ensure instance console log exists: /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Successfully updated port: b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "refresh_cache-d78558e6-437e-44dd-b6b4-123ed3447094" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquired lock "refresh_cache-d78558e6-437e-44dd-b6b4-123ed3447094" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Received event network-changed-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Refreshing instance network info cache due to event network-changed-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] Acquiring lock "refresh_cache-d78558e6-437e-44dd-b6b4-123ed3447094" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280816.5597131, 7141c80d-34a9-40cc-a792-b01ffd9155b6 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:26:56 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] VM Resumed (Lifecycle Event)
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:26:56 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Instance spawned successfully.
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:26:56 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280816.5605261, 7141c80d-34a9-40cc-a792-b01ffd9155b6 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:26:56 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] VM Started (Lifecycle Event)
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2982f35-07b7-4f67-8ee0-b1d92496182b tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.729s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Updating instance_info_cache with network_info: [{"id": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "address": "fa:16:3e:c2:55:e5", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fc0ea9-eb", "ovs_interfaceid": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Releasing lock "refresh_cache-d78558e6-437e-44dd-b6b4-123ed3447094" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Instance network_info: |[{"id": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "address": "fa:16:3e:c2:55:e5", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fc0ea9-eb", "ovs_interfaceid": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] Acquired lock "refresh_cache-d78558e6-437e-44dd-b6b4-123ed3447094" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.network.neutron [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Refreshing network info cache for port b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Start _get_guest_xml network_info=[{"id": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "address": "fa:16:3e:c2:55:e5", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fc0ea9-eb", "ovs_interfaceid": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:26:56 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:26:56 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-322960618',display_name='tempest-VolumesAdminNegativeTest-server-322960618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-322960618',id=16,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD65dE2pmIa6Mfx/K+bCSPXnuq3dvIWAreTtSp1xAwHIKyD+AYVbf8VY+daMgeHQNbUc8pnSFCiLNei+4la99e6HF1pBOjNJp35njArMoDgjdZo+g6dLiFEWe9TBcGXsNg==',key_name='tempest-keypair-1771315456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b656fa0bf05484889563c50ccc9a7e9',ramdisk_id='',reservation_id='r-yxqyyqa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1313851069',owner_user_name='tempest-VolumesAdminNegativeTest-1313851069-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:26:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d682efe6338b4989beb714cce25e8e31',uuid=d78558e6-437e-44dd-b6b4-123ed3447094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "address": "fa:16:3e:c2:55:e5", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fc0ea9-eb", "ovs_interfaceid": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Converting VIF {"id": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "address": "fa:16:3e:c2:55:e5", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fc0ea9-eb", "ovs_interfaceid": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:55:e5,bridge_name='br-int',has_traffic_filtering=True,id=b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fc0ea9-eb') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.objects.instance [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lazy-loading 'pci_devices' on Instance uuid d78558e6-437e-44dd-b6b4-123ed3447094 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:26:56 user nova-compute[71711]:   <uuid>d78558e6-437e-44dd-b6b4-123ed3447094</uuid>
Apr 12 06:26:56 user nova-compute[71711]:   <name>instance-00000010</name>
Apr 12 06:26:56 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:26:56 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:26:56 user nova-compute[71711]:   <metadata>
Apr 12 06:26:56 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:26:56 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:26:56 user nova-compute[71711]:       <nova:name>tempest-VolumesAdminNegativeTest-server-322960618</nova:name>
Apr 12 06:26:56 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:26:56</nova:creationTime>
Apr 12 06:26:56 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:26:56 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:26:56 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:26:56 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:26:56 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:26:56 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:26:56 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:26:56 user nova-compute[71711]:       <nova:owner>
Apr 12 06:26:56 user nova-compute[71711]:         <nova:user uuid="d682efe6338b4989beb714cce25e8e31">tempest-VolumesAdminNegativeTest-1313851069-project-member</nova:user>
Apr 12 06:26:56 user nova-compute[71711]:         <nova:project uuid="0b656fa0bf05484889563c50ccc9a7e9">tempest-VolumesAdminNegativeTest-1313851069</nova:project>
Apr 12 06:26:56 user nova-compute[71711]:       </nova:owner>
Apr 12 06:26:56 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:26:56 user nova-compute[71711]:       <nova:ports>
Apr 12 06:26:56 user nova-compute[71711]:         <nova:port uuid="b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea">
Apr 12 06:26:56 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 06:26:56 user nova-compute[71711]:         </nova:port>
Apr 12 06:26:56 user nova-compute[71711]:       </nova:ports>
Apr 12 06:26:56 user nova-compute[71711]:     </nova:instance>
Apr 12 06:26:56 user nova-compute[71711]:   </metadata>
Apr 12 06:26:56 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:26:56 user nova-compute[71711]:     <system>
Apr 12 06:26:56 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:26:56 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:26:56 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:26:56 user nova-compute[71711]:       <entry name="serial">d78558e6-437e-44dd-b6b4-123ed3447094</entry>
Apr 12 06:26:56 user nova-compute[71711]:       <entry name="uuid">d78558e6-437e-44dd-b6b4-123ed3447094</entry>
Apr 12 06:26:56 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:26:56 user nova-compute[71711]:     </system>
Apr 12 06:26:56 user nova-compute[71711]:   </sysinfo>
Apr 12 06:26:56 user nova-compute[71711]:   <os>
Apr 12 06:26:56 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:26:56 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:26:56 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:26:56 user nova-compute[71711]:   </os>
Apr 12 06:26:56 user nova-compute[71711]:   <features>
Apr 12 06:26:56 user nova-compute[71711]:     <acpi/>
Apr 12 06:26:56 user nova-compute[71711]:     <apic/>
Apr 12 06:26:56 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:26:56 user nova-compute[71711]:   </features>
Apr 12 06:26:56 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:26:56 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:26:56 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:26:56 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:26:56 user nova-compute[71711]:   </clock>
Apr 12 06:26:56 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:26:56 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:26:56 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:26:56 user nova-compute[71711]:   </cpu>
Apr 12 06:26:56 user nova-compute[71711]:   <devices>
Apr 12 06:26:56 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:26:56 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:26:56 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk"/>
Apr 12 06:26:56 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:26:56 user nova-compute[71711]:     </disk>
Apr 12 06:26:56 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:26:56 user nova-compute[71711]:       <mac address="fa:16:3e:c2:55:e5"/>
Apr 12 06:26:56 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:26:56 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:26:56 user nova-compute[71711]:       <target dev="tapb9fc0ea9-eb"/>
Apr 12 06:26:56 user nova-compute[71711]:     </interface>
Apr 12 06:26:56 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:26:56 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/console.log" append="off"/>
Apr 12 06:26:56 user nova-compute[71711]:     </serial>
Apr 12 06:26:56 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:26:56 user nova-compute[71711]:     <video>
Apr 12 06:26:56 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:26:56 user nova-compute[71711]:     </video>
Apr 12 06:26:56 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:26:56 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:26:56 user nova-compute[71711]:     </rng>
Apr 12 06:26:56 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:26:56 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:26:56 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:26:56 user nova-compute[71711]:     </memballoon>
Apr 12 06:26:56 user nova-compute[71711]:   </devices>
Apr 12 06:26:56 user nova-compute[71711]: </domain>
Apr 12 06:26:56 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-322960618',display_name='tempest-VolumesAdminNegativeTest-server-322960618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-322960618',id=16,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD65dE2pmIa6Mfx/K+bCSPXnuq3dvIWAreTtSp1xAwHIKyD+AYVbf8VY+daMgeHQNbUc8pnSFCiLNei+4la99e6HF1pBOjNJp35njArMoDgjdZo+g6dLiFEWe9TBcGXsNg==',key_name='tempest-keypair-1771315456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b656fa0bf05484889563c50ccc9a7e9',ramdisk_id='',reservation_id='r-yxqyyqa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1313851069',owner_user_name='tempest-VolumesAdminNegativeTest-1313851069-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:26:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d682efe6338b4989beb714cce25e8e31',uuid=d78558e6-437e-44dd-b6b4-123ed3447094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "address": "fa:16:3e:c2:55:e5", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fc0ea9-eb", "ovs_interfaceid": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Converting VIF {"id": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "address": "fa:16:3e:c2:55:e5", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fc0ea9-eb", "ovs_interfaceid": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:55:e5,bridge_name='br-int',has_traffic_filtering=True,id=b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fc0ea9-eb') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG os_vif [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:55:e5,bridge_name='br-int',has_traffic_filtering=True,id=b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fc0ea9-eb') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-6e7fe578-d3ce-4716-b711-1be5454c75a9 req-7bde2fda-711a-4d5a-80a4-a3b0f94b465c service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6e7fe578-d3ce-4716-b711-1be5454c75a9 req-7bde2fda-711a-4d5a-80a4-a3b0f94b465c service nova] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6e7fe578-d3ce-4716-b711-1be5454c75a9 req-7bde2fda-711a-4d5a-80a4-a3b0f94b465c service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6e7fe578-d3ce-4716-b711-1be5454c75a9 req-7bde2fda-711a-4d5a-80a4-a3b0f94b465c service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-6e7fe578-d3ce-4716-b711-1be5454c75a9 req-7bde2fda-711a-4d5a-80a4-a3b0f94b465c service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] No waiting events found dispatching network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:26:56 user nova-compute[71711]: WARNING nova.compute.manager [req-6e7fe578-d3ce-4716-b711-1be5454c75a9 req-7bde2fda-711a-4d5a-80a4-a3b0f94b465c service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received unexpected event network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 for instance with vm_state active and task_state None.
Apr 12 06:26:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9fc0ea9-eb, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9fc0ea9-eb, col_values=(('external_ids', {'iface-id': 'b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:55:e5', 'vm-uuid': 'd78558e6-437e-44dd-b6b4-123ed3447094'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:56 user nova-compute[71711]: INFO os_vif [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:55:e5,bridge_name='br-int',has_traffic_filtering=True,id=b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fc0ea9-eb')
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:26:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] No VIF found with MAC fa:16:3e:c2:55:e5, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:26:57 user nova-compute[71711]: DEBUG nova.network.neutron [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Updated VIF entry in instance network info cache for port b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:26:57 user nova-compute[71711]: DEBUG nova.network.neutron [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Updating instance_info_cache with network_info: [{"id": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "address": "fa:16:3e:c2:55:e5", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fc0ea9-eb", "ovs_interfaceid": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:26:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ef92b804-cbdf-465a-b732-1388454bf3f1 req-4d0c42c8-06d9-42dc-89d8-aa32e7139123 service nova] Releasing lock "refresh_cache-d78558e6-437e-44dd-b6b4-123ed3447094" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:26:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-e0fa2359-59e1-4640-8662-a42960e7bb4b req-66297502-18fd-4e68-9a1a-848a0615eb34 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Received event network-vif-plugged-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:26:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e0fa2359-59e1-4640-8662-a42960e7bb4b req-66297502-18fd-4e68-9a1a-848a0615eb34 service nova] Acquiring lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:26:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e0fa2359-59e1-4640-8662-a42960e7bb4b req-66297502-18fd-4e68-9a1a-848a0615eb34 service nova] Lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:26:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e0fa2359-59e1-4640-8662-a42960e7bb4b req-66297502-18fd-4e68-9a1a-848a0615eb34 service nova] Lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:26:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-e0fa2359-59e1-4640-8662-a42960e7bb4b req-66297502-18fd-4e68-9a1a-848a0615eb34 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] No waiting events found dispatching network-vif-plugged-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:26:58 user nova-compute[71711]: WARNING nova.compute.manager [req-e0fa2359-59e1-4640-8662-a42960e7bb4b req-66297502-18fd-4e68-9a1a-848a0615eb34 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Received unexpected event network-vif-plugged-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea for instance with vm_state building and task_state spawning.
Apr 12 06:26:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:26:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280820.4485915, d78558e6-437e-44dd-b6b4-123ed3447094 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:27:00 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] VM Resumed (Lifecycle Event)
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:27:00 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Instance spawned successfully.
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:27:00 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280820.4524753, d78558e6-437e-44dd-b6b4-123ed3447094 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:27:00 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] VM Started (Lifecycle Event)
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:27:00 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:27:00 user nova-compute[71711]: INFO nova.compute.manager [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Took 5.59 seconds to spawn the instance on the hypervisor.
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-d4ed36ab-5ddc-43e7-88dd-8d9c4c3b43c2 req-672af7b2-d8b6-46bb-bb08-0a295d9dc132 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Received event network-vif-plugged-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d4ed36ab-5ddc-43e7-88dd-8d9c4c3b43c2 req-672af7b2-d8b6-46bb-bb08-0a295d9dc132 service nova] Acquiring lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d4ed36ab-5ddc-43e7-88dd-8d9c4c3b43c2 req-672af7b2-d8b6-46bb-bb08-0a295d9dc132 service nova] Lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d4ed36ab-5ddc-43e7-88dd-8d9c4c3b43c2 req-672af7b2-d8b6-46bb-bb08-0a295d9dc132 service nova] Lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-d4ed36ab-5ddc-43e7-88dd-8d9c4c3b43c2 req-672af7b2-d8b6-46bb-bb08-0a295d9dc132 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] No waiting events found dispatching network-vif-plugged-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:00 user nova-compute[71711]: WARNING nova.compute.manager [req-d4ed36ab-5ddc-43e7-88dd-8d9c4c3b43c2 req-672af7b2-d8b6-46bb-bb08-0a295d9dc132 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Received unexpected event network-vif-plugged-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea for instance with vm_state building and task_state spawning.
Apr 12 06:27:00 user nova-compute[71711]: INFO nova.compute.manager [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Took 6.47 seconds to build instance.
Apr 12 06:27:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6e0c4229-e81f-456e-a218-bf23267aa577 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "d78558e6-437e-44dd-b6b4-123ed3447094" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.566s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:09 user nova-compute[71711]: DEBUG nova.compute.manager [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-changed-84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:09 user nova-compute[71711]: DEBUG nova.compute.manager [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing instance network info cache due to event network-changed-84ce2803-724b-484e-8673-6959fd03fdc9. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:27:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] Acquiring lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:27:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] Acquired lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:27:09 user nova-compute[71711]: DEBUG nova.network.neutron [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Refreshing network info cache for port 84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:27:10 user nova-compute[71711]: DEBUG nova.network.neutron [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updated VIF entry in instance network info cache for port 84ce2803-724b-484e-8673-6959fd03fdc9. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:27:10 user nova-compute[71711]: DEBUG nova.network.neutron [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating instance_info_cache with network_info: [{"id": "84ce2803-724b-484e-8673-6959fd03fdc9", "address": "fa:16:3e:c4:ce:d4", "network": {"id": "487458d7-109b-469f-914b-1d6d01919059", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-588553343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ce2803-72", "ovs_interfaceid": "84ce2803-724b-484e-8673-6959fd03fdc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44948ebb-503b-4166-936e-6c4101625453", "address": "fa:16:3e:8e:09:1e", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44948ebb-50", "ovs_interfaceid": "44948ebb-503b-4166-936e-6c4101625453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "350ec490-a274-4fe0-a88d-4d558e0d4337", "address": "fa:16:3e:b5:ee:af", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ec490-a2", "ovs_interfaceid": "350ec490-a274-4fe0-a88d-4d558e0d4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36083c4a-f152-4716-a60d-0197287d6ba1", "address": "fa:16:3e:88:72:ce", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36083c4a-f1", "ovs_interfaceid": "36083c4a-f152-4716-a60d-0197287d6ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "address": "fa:16:3e:af:68:17", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cbdfd5-31", "ovs_interfaceid": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "address": "fa:16:3e:57:ac:38", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce0028f-12", "ovs_interfaceid": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "address": "fa:16:3e:fd:1c:be", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8e308b-ba", "ovs_interfaceid": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:27:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-faf342f7-5b30-44bb-8148-011cb361409d req-c2dbbb98-e398-4e42-b17d-82ba7c1652a7 service nova] Releasing lock "refresh_cache-d15be760-180e-4335-b670-ecd8873609b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "d15be760-180e-4335-b670-ecd8873609b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:11 user nova-compute[71711]: INFO nova.compute.manager [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Terminating instance
Apr 12 06:27:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-4df80bf2-07e7-49d9-8cc4-5dd9486946ac req-a87eec57-ac41-43dc-9f44-50e06e53c7d0 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4df80bf2-07e7-49d9-8cc4-5dd9486946ac req-a87eec57-ac41-43dc-9f44-50e06e53c7d0 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4df80bf2-07e7-49d9-8cc4-5dd9486946ac req-a87eec57-ac41-43dc-9f44-50e06e53c7d0 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4df80bf2-07e7-49d9-8cc4-5dd9486946ac req-a87eec57-ac41-43dc-9f44-50e06e53c7d0 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-4df80bf2-07e7-49d9-8cc4-5dd9486946ac req-a87eec57-ac41-43dc-9f44-50e06e53c7d0 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-unplugged-84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-4df80bf2-07e7-49d9-8cc4-5dd9486946ac req-a87eec57-ac41-43dc-9f44-50e06e53c7d0 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-84ce2803-724b-484e-8673-6959fd03fdc9 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-d2f5c84c-f086-4792-9f73-1a05383d1228 req-c612c7e4-6850-4301-b62f-5cc20febe7fb service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-44948ebb-503b-4166-936e-6c4101625453 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d2f5c84c-f086-4792-9f73-1a05383d1228 req-c612c7e4-6850-4301-b62f-5cc20febe7fb service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d2f5c84c-f086-4792-9f73-1a05383d1228 req-c612c7e4-6850-4301-b62f-5cc20febe7fb service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d2f5c84c-f086-4792-9f73-1a05383d1228 req-c612c7e4-6850-4301-b62f-5cc20febe7fb service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-d2f5c84c-f086-4792-9f73-1a05383d1228 req-c612c7e4-6850-4301-b62f-5cc20febe7fb service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-unplugged-44948ebb-503b-4166-936e-6c4101625453 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-d2f5c84c-f086-4792-9f73-1a05383d1228 req-c612c7e4-6850-4301-b62f-5cc20febe7fb service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-44948ebb-503b-4166-936e-6c4101625453 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: d15be760-180e-4335-b670-ecd8873609b4] Instance destroyed successfully.
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lazy-loading 'resources' on Instance uuid d15be760-180e-4335-b670-ecd8873609b4 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:25:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84ce2803-724b-484e-8673-6959fd03fdc9", "address": "fa:16:3e:c4:ce:d4", "network": {"id": "487458d7-109b-469f-914b-1d6d01919059", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-588553343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ce2803-72", "ovs_interfaceid": "84ce2803-724b-484e-8673-6959fd03fdc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "84ce2803-724b-484e-8673-6959fd03fdc9", "address": "fa:16:3e:c4:ce:d4", "network": {"id": "487458d7-109b-469f-914b-1d6d01919059", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-588553343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ce2803-72", "ovs_interfaceid": "84ce2803-724b-484e-8673-6959fd03fdc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=84ce2803-724b-484e-8673-6959fd03fdc9,network=Network(487458d7-109b-469f-914b-1d6d01919059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ce2803-72') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=84ce2803-724b-484e-8673-6959fd03fdc9,network=Network(487458d7-109b-469f-914b-1d6d01919059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ce2803-72') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84ce2803-72, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: INFO os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:ce:d4,bridge_name='br-int',has_traffic_filtering=True,id=84ce2803-724b-484e-8673-6959fd03fdc9,network=Network(487458d7-109b-469f-914b-1d6d01919059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84ce2803-72')
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:25:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44948ebb-503b-4166-936e-6c4101625453", "address": "fa:16:3e:8e:09:1e", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44948ebb-50", "ovs_interfaceid": "44948ebb-503b-4166-936e-6c4101625453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "44948ebb-503b-4166-936e-6c4101625453", "address": "fa:16:3e:8e:09:1e", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44948ebb-50", "ovs_interfaceid": "44948ebb-503b-4166-936e-6c4101625453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:09:1e,bridge_name='br-int',has_traffic_filtering=True,id=44948ebb-503b-4166-936e-6c4101625453,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44948ebb-50') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:09:1e,bridge_name='br-int',has_traffic_filtering=True,id=44948ebb-503b-4166-936e-6c4101625453,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44948ebb-50') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44948ebb-50, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: INFO os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:09:1e,bridge_name='br-int',has_traffic_filtering=True,id=44948ebb-503b-4166-936e-6c4101625453,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44948ebb-50')
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:25:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350ec490-a274-4fe0-a88d-4d558e0d4337", "address": "fa:16:3e:b5:ee:af", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ec490-a2", "ovs_interfaceid": "350ec490-a274-4fe0-a88d-4d558e0d4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "350ec490-a274-4fe0-a88d-4d558e0d4337", "address": "fa:16:3e:b5:ee:af", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ec490-a2", "ovs_interfaceid": "350ec490-a274-4fe0-a88d-4d558e0d4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:ee:af,bridge_name='br-int',has_traffic_filtering=True,id=350ec490-a274-4fe0-a88d-4d558e0d4337,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap350ec490-a2') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:ee:af,bridge_name='br-int',has_traffic_filtering=True,id=350ec490-a274-4fe0-a88d-4d558e0d4337,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap350ec490-a2') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap350ec490-a2, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: INFO os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:ee:af,bridge_name='br-int',has_traffic_filtering=True,id=350ec490-a274-4fe0-a88d-4d558e0d4337,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap350ec490-a2')
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:25:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36083c4a-f152-4716-a60d-0197287d6ba1", "address": "fa:16:3e:88:72:ce", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36083c4a-f1", "ovs_interfaceid": "36083c4a-f152-4716-a60d-0197287d6ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "36083c4a-f152-4716-a60d-0197287d6ba1", "address": "fa:16:3e:88:72:ce", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36083c4a-f1", "ovs_interfaceid": "36083c4a-f152-4716-a60d-0197287d6ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:72:ce,bridge_name='br-int',has_traffic_filtering=True,id=36083c4a-f152-4716-a60d-0197287d6ba1,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36083c4a-f1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:72:ce,bridge_name='br-int',has_traffic_filtering=True,id=36083c4a-f152-4716-a60d-0197287d6ba1,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36083c4a-f1') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36083c4a-f1, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: INFO os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:72:ce,bridge_name='br-int',has_traffic_filtering=True,id=36083c4a-f152-4716-a60d-0197287d6ba1,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36083c4a-f1')
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:25:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "address": "fa:16:3e:af:68:17", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cbdfd5-31", "ovs_interfaceid": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "address": "fa:16:3e:af:68:17", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cbdfd5-31", "ovs_interfaceid": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:68:17,bridge_name='br-int',has_traffic_filtering=True,id=22cbdfd5-3118-4729-87fb-5f9f6e4f005c,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cbdfd5-31') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:68:17,bridge_name='br-int',has_traffic_filtering=True,id=22cbdfd5-3118-4729-87fb-5f9f6e4f005c,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cbdfd5-31') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22cbdfd5-31, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: INFO os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:68:17,bridge_name='br-int',has_traffic_filtering=True,id=22cbdfd5-3118-4729-87fb-5f9f6e4f005c,network=Network(09a9d52e-7141-4591-a5a9-d93a1668c0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cbdfd5-31')
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:25:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "address": "fa:16:3e:57:ac:38", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce0028f-12", "ovs_interfaceid": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "address": "fa:16:3e:57:ac:38", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce0028f-12", "ovs_interfaceid": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:ac:38,bridge_name='br-int',has_traffic_filtering=True,id=dce0028f-1206-43bb-96c1-d3cbd8f57103,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce0028f-12') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:ac:38,bridge_name='br-int',has_traffic_filtering=True,id=dce0028f-1206-43bb-96c1-d3cbd8f57103,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce0028f-12') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdce0028f-12, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: INFO os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:ac:38,bridge_name='br-int',has_traffic_filtering=True,id=dce0028f-1206-43bb-96c1-d3cbd8f57103,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdce0028f-12')
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T06:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1994861012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1994861012',id=12,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhXcloQ4GIY5SFTwfu4BLdiaxiPp+j3bH9BZQHMBEmWY1KDcqG2gY2u7+V1k0Vg38ylztB+ttYYrij5VK5oYwMJ46vag8bbZ88qVAHEyQImFV76t5RyAoWTkSIlFX3q+Q==',key_name='tempest-keypair-1769866146',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:25:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b22588bca2c46f09b19d28bcf76db06',ramdisk_id='',reservation_id='r-ja75sdiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1618985724',owner_user_name='tempest-TaggedBootDevicesTest-1618985724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d195bbdaf94ac9bfdba8f76157a10f',uuid=d15be760-180e-4335-b670-ecd8873609b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "address": "fa:16:3e:fd:1c:be", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8e308b-ba", "ovs_interfaceid": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converting VIF {"id": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "address": "fa:16:3e:fd:1c:be", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe8e308b-ba", "ovs_interfaceid": "be8e308b-ba21-4e98-95bf-af2ae6446d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=be8e308b-ba21-4e98-95bf-af2ae6446d20,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8e308b-ba') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=be8e308b-ba21-4e98-95bf-af2ae6446d20,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8e308b-ba') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe8e308b-ba, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:27:13 user nova-compute[71711]: INFO os_vif [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:1c:be,bridge_name='br-int',has_traffic_filtering=True,id=be8e308b-ba21-4e98-95bf-af2ae6446d20,network=Network(f7d32909-b6bd-4374-a598-a86d2fca37bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe8e308b-ba')
Apr 12 06:27:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFGiWOnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:27:13 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c68564-af2b-419c-91d8-275701935b9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:27:13 user nova-compute[71711]: No targets found.
Apr 12 06:27:13 user nova-compute[71711]: iSNS:
Apr 12 06:27:13 user nova-compute[71711]: No targets found.
Apr 12 06:27:13 user nova-compute[71711]: STATIC:
Apr 12 06:27:13 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:27:13 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:13 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:13 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090
Apr 12 06:27:13 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:13 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:13 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f
Apr 12 06:27:13 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:13 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:13 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:27:13 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:13 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:13 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88
Apr 12 06:27:13 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:13 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:13 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975
Apr 12 06:27:13 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:13 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:13 user nova-compute[71711]: FIRMWARE:
Apr 12 06:27:13 user nova-compute[71711]: No targets found.
Apr 12 06:27:13 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:27:13 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:27:13 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[924f3b27-0277-4674-9a0e-504cdae22848]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[934284dc-36e0-4cfc-8ed4-d94555a2d9ec]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:27:13 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:27:13 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:27:13 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:27:13 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:13 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:13 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f (non-flash)
Apr 12 06:27:13 user nova-compute[71711]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:27:13 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:27:13 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:27:13 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:13 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:13 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:27:13 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c368310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f'): ({'sdb'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Removing single pathed devices sdb {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdc5a7f-445a-40fa-b234-351a4c33a6fc]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f8694-2eb0-4f87-a5e3-c90a42f2b8e8]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Flushing IO for device /dev/sdb {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f84150b-bc3d-4c25-88bf-ae02cf59956b]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a6ce4e-a392-4c85-9b16-ca94f31c91db]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:14 user nova-compute[71711]: WARNING nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-84ce2803-724b-484e-8673-6959fd03fdc9 for instance with vm_state active and task_state deleting.
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-350ec490-a274-4fe0-a88d-4d558e0d4337 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-unplugged-350ec490-a274-4fe0-a88d-4d558e0d4337 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-350ec490-a274-4fe0-a88d-4d558e0d4337 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-350ec490-a274-4fe0-a88d-4d558e0d4337 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-350ec490-a274-4fe0-a88d-4d558e0d4337 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:14 user nova-compute[71711]: WARNING nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-350ec490-a274-4fe0-a88d-4d558e0d4337 for instance with vm_state active and task_state deleting.
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-36083c4a-f152-4716-a60d-0197287d6ba1 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-unplugged-36083c4a-f152-4716-a60d-0197287d6ba1 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-36083c4a-f152-4716-a60d-0197287d6ba1 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-36083c4a-f152-4716-a60d-0197287d6ba1 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-36083c4a-f152-4716-a60d-0197287d6ba1 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:14 user nova-compute[71711]: WARNING nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-36083c4a-f152-4716-a60d-0197287d6ba1 for instance with vm_state active and task_state deleting.
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-22cbdfd5-3118-4729-87fb-5f9f6e4f005c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-unplugged-22cbdfd5-3118-4729-87fb-5f9f6e4f005c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-22cbdfd5-3118-4729-87fb-5f9f6e4f005c for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-22cbdfd5-3118-4729-87fb-5f9f6e4f005c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-22cbdfd5-3118-4729-87fb-5f9f6e4f005c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:14 user nova-compute[71711]: WARNING nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-22cbdfd5-3118-4729-87fb-5f9f6e4f005c for instance with vm_state active and task_state deleting.
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-dce0028f-1206-43bb-96c1-d3cbd8f57103 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-unplugged-dce0028f-1206-43bb-96c1-d3cbd8f57103 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-dce0028f-1206-43bb-96c1-d3cbd8f57103 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-dce0028f-1206-43bb-96c1-d3cbd8f57103 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-dce0028f-1206-43bb-96c1-d3cbd8f57103 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:14 user nova-compute[71711]: WARNING nova.compute.manager [req-ee0a865b-0fcc-4b82-ad59-09f608dbfdcf req-c39be168-120d-48f1-bd96-b09686e9c12b service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-dce0028f-1206-43bb-96c1-d3cbd8f57103 for instance with vm_state active and task_state deleting.
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[600863c8-f3f6-45cf-a970-c2d3290f755c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-44948ebb-503b-4166-936e-6c4101625453 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-44948ebb-503b-4166-936e-6c4101625453 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:14 user nova-compute[71711]: WARNING nova.compute.manager [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-44948ebb-503b-4166-936e-6c4101625453 for instance with vm_state active and task_state deleting.
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-be8e308b-ba21-4e98-95bf-af2ae6446d20 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-unplugged-be8e308b-ba21-4e98-95bf-af2ae6446d20 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-unplugged-be8e308b-ba21-4e98-95bf-af2ae6446d20 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-plugged-be8e308b-ba21-4e98-95bf-af2ae6446d20 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Acquiring lock "d15be760-180e-4335-b670-ecd8873609b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] Lock "d15be760-180e-4335-b670-ecd8873609b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] No waiting events found dispatching network-vif-plugged-be8e308b-ba21-4e98-95bf-af2ae6446d20 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:14 user nova-compute[71711]: WARNING nova.compute.manager [req-ad1c3af6-08d0-480a-9354-55571b4b404f req-19203f9a-2ae0-4e51-9f96-25d7073064a7 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received unexpected event network-vif-plugged-be8e308b-ba21-4e98-95bf-af2ae6446d20 for instance with vm_state active and task_state deleting.
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[addffef3-fad5-4d65-9f1f-e5312d3e9291]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f, portal: 172.16.0.220,3260]
Apr 12 06:27:14 user nova-compute[71711]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f, portal: 172.16.0.220,3260] successful.
Apr 12 06:27:14 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ddfeaf-9407-49e8-abb1-f5c9d23dab3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d982483-f493-41b6-a337-5f21f67bcbda]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] <== disconnect_volume: return (363ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hOloYSmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:27:14 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f294ec00-5b1b-4c6e-adb4-e1376cee8e2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:27:14 user nova-compute[71711]: No targets found.
Apr 12 06:27:14 user nova-compute[71711]: iSNS:
Apr 12 06:27:14 user nova-compute[71711]: No targets found.
Apr 12 06:27:14 user nova-compute[71711]: STATIC:
Apr 12 06:27:14 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:27:14 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:14 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:14 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090
Apr 12 06:27:14 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:14 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:14 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:27:14 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:14 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:14 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88
Apr 12 06:27:14 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:14 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:14 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975
Apr 12 06:27:14 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:14 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:14 user nova-compute[71711]: FIRMWARE:
Apr 12 06:27:14 user nova-compute[71711]: No targets found.
Apr 12 06:27:14 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:27:14 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:27:14 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7391143-3260-497a-a4cc-cae96aa80b87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7e93fd-3829-425f-8d39-e974e9846917]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:14 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:14 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c253490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090'): ({'sdc'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Removing single pathed devices sdc {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fc9da5-91b7-471b-b1f3-e18696f34903]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e81d1c-a044-43f2-b54d-b498bc8677e5]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Flushing IO for device /dev/sdc {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58be997-a266-407e-b836-931784c600a0]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedbf4d9-8fbc-4a7e-b5e6-89105bde8654]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fb0e52-0806-4e68-8826-dcf3dc527204]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dec393-196a-4477-bf74-cd69a10043a3]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090, portal: 172.16.0.220,3260]
Apr 12 06:27:14 user nova-compute[71711]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090, portal: 172.16.0.220,3260] successful.
Apr 12 06:27:14 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c9b01f5-884d-4f16-b344-ea6facab9090 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cde1cb7-9bd5-4a4e-9d41-4fc74852b9d0]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] <== disconnect_volume: return (316ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIhHWXGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:27:14 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02cee09-c83f-4358-91a4-d266f9e8eec6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:27:14 user nova-compute[71711]: No targets found.
Apr 12 06:27:14 user nova-compute[71711]: iSNS:
Apr 12 06:27:14 user nova-compute[71711]: No targets found.
Apr 12 06:27:14 user nova-compute[71711]: STATIC:
Apr 12 06:27:14 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:27:14 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:14 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:14 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:27:14 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:14 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:14 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88
Apr 12 06:27:14 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:14 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:14 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975
Apr 12 06:27:14 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:14 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:14 user nova-compute[71711]: FIRMWARE:
Apr 12 06:27:14 user nova-compute[71711]: No targets found.
Apr 12 06:27:14 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:27:14 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:27:14 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[51138aa2-7249-496a-87a7-c4ac23eaaee1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edef9c8-a4c1-46bd-b4e2-03a85ec42ab9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:14 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:14 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:14 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c253a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88'): ({'sdd'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Removing single pathed devices sdd {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2395219f-88ff-44ab-9a11-d6c81fc56e78]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[312ad292-1ad2-43b6-8720-6809a78be053]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Flushing IO for device /dev/sdd {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0c20d9-7c81-4546-8d4a-ae988a74ac62]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c66c2e-265e-44c7-863f-0a5aa62ff601]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9275d2b8-c5d8-4f9b-aa3b-4fd4da241791]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d8176e-9ae3-430a-a392-7e7409e768f8]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88, portal: 172.16.0.220,3260]
Apr 12 06:27:14 user nova-compute[71711]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88, portal: 172.16.0.220,3260] successful.
Apr 12 06:27:14 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c75bc08-5a02-4b60-9201-616a5a4f1d88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[927d25b0-dc7e-45f4-bad6-6b03b67531b3]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] <== disconnect_volume: return (307ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:27:14 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Deleting instance files /opt/stack/data/nova/instances/d15be760-180e-4335-b670-ecd8873609b4_del
Apr 12 06:27:14 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Deletion of /opt/stack/data/nova/instances/d15be760-180e-4335-b670-ecd8873609b4_del complete
Apr 12 06:27:14 user nova-compute[71711]: INFO nova.compute.manager [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Took 3.30 seconds to destroy the instance on the hypervisor.
Apr 12 06:27:14 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: d15be760-180e-4335-b670-ecd8873609b4] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:27:14 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: d15be760-180e-4335-b670-ecd8873609b4] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:27:16 user nova-compute[71711]: DEBUG nova.compute.manager [req-9a85a869-90e4-4d0f-bf60-4724fbb543b1 req-45bc0abe-48bc-43ee-82ad-1bebf6b7cdf4 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-deleted-be8e308b-ba21-4e98-95bf-af2ae6446d20 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:16 user nova-compute[71711]: INFO nova.compute.manager [req-9a85a869-90e4-4d0f-bf60-4724fbb543b1 req-45bc0abe-48bc-43ee-82ad-1bebf6b7cdf4 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Neutron deleted interface be8e308b-ba21-4e98-95bf-af2ae6446d20; detaching it from the instance and deleting it from the info cache
Apr 12 06:27:16 user nova-compute[71711]: DEBUG nova.network.neutron [req-9a85a869-90e4-4d0f-bf60-4724fbb543b1 req-45bc0abe-48bc-43ee-82ad-1bebf6b7cdf4 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating instance_info_cache with network_info: [{"id": "84ce2803-724b-484e-8673-6959fd03fdc9", "address": "fa:16:3e:c4:ce:d4", "network": {"id": "487458d7-109b-469f-914b-1d6d01919059", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-588553343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84ce2803-72", "ovs_interfaceid": "84ce2803-724b-484e-8673-6959fd03fdc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44948ebb-503b-4166-936e-6c4101625453", "address": "fa:16:3e:8e:09:1e", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44948ebb-50", "ovs_interfaceid": "44948ebb-503b-4166-936e-6c4101625453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "350ec490-a274-4fe0-a88d-4d558e0d4337", "address": "fa:16:3e:b5:ee:af", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350ec490-a2", "ovs_interfaceid": "350ec490-a274-4fe0-a88d-4d558e0d4337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36083c4a-f152-4716-a60d-0197287d6ba1", "address": "fa:16:3e:88:72:ce", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36083c4a-f1", "ovs_interfaceid": "36083c4a-f152-4716-a60d-0197287d6ba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "address": "fa:16:3e:af:68:17", "network": {"id": "09a9d52e-7141-4591-a5a9-d93a1668c0dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1345084706", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cbdfd5-31", "ovs_interfaceid": "22cbdfd5-3118-4729-87fb-5f9f6e4f005c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "address": "fa:16:3e:57:ac:38", "network": {"id": "f7d32909-b6bd-4374-a598-a86d2fca37bc", "bridge": "br-int", "label": "tempest-device-tagging-net2-8636448", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6b22588bca2c46f09b19d28bcf76db06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdce0028f-12", "ovs_interfaceid": "dce0028f-1206-43bb-96c1-d3cbd8f57103", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:27:16 user nova-compute[71711]: DEBUG nova.compute.manager [req-9a85a869-90e4-4d0f-bf60-4724fbb543b1 req-45bc0abe-48bc-43ee-82ad-1bebf6b7cdf4 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Detach interface failed, port_id=be8e308b-ba21-4e98-95bf-af2ae6446d20, reason: Instance d15be760-180e-4335-b670-ecd8873609b4 could not be found. {{(pid=71711) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 06:27:18 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: d15be760-180e-4335-b670-ecd8873609b4] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:27:18 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: d15be760-180e-4335-b670-ecd8873609b4] Took 3.06 seconds to deallocate network for instance.
Apr 12 06:27:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-2863e22d-a4b1-42b8-84a6-f738f116155f req-c6e789f1-ca6e-4333-abb5-de08ed8445f9 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-deleted-36083c4a-f152-4716-a60d-0197287d6ba1 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-2863e22d-a4b1-42b8-84a6-f738f116155f req-c6e789f1-ca6e-4333-abb5-de08ed8445f9 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-deleted-dce0028f-1206-43bb-96c1-d3cbd8f57103 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-2863e22d-a4b1-42b8-84a6-f738f116155f req-c6e789f1-ca6e-4333-abb5-de08ed8445f9 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-deleted-22cbdfd5-3118-4729-87fb-5f9f6e4f005c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-2863e22d-a4b1-42b8-84a6-f738f116155f req-c6e789f1-ca6e-4333-abb5-de08ed8445f9 service nova] [instance: d15be760-180e-4335-b670-ecd8873609b4] Received event network-vif-deleted-84ce2803-724b-484e-8673-6959fd03fdc9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:20 user nova-compute[71711]: INFO nova.compute.manager [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] [instance: d15be760-180e-4335-b670-ecd8873609b4] Took 2.31 seconds to detach 3 volumes for instance.
Apr 12 06:27:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:20 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:27:20 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:27:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:20 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Deleted allocations for instance d15be760-180e-4335-b670-ecd8873609b4
Apr 12 06:27:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a630354e-5c7e-40c9-8549-103fee1dc31c tempest-TaggedBootDevicesTest-1618985724 tempest-TaggedBootDevicesTest-1618985724-project-member] Lock "d15be760-180e-4335-b670-ecd8873609b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.181s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:28 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280833.5606217, d15be760-180e-4335-b670-ecd8873609b4 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:27:28 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: d15be760-180e-4335-b670-ecd8873609b4] VM Stopped (Lifecycle Event)
Apr 12 06:27:28 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ccfc3c3b-6629-4164-b691-5d5b76a7f663 None None] [instance: d15be760-180e-4335-b670-ecd8873609b4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:27:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:31 user nova-compute[71711]: INFO nova.compute.manager [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Detaching volume 34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:27:31 user nova-compute[71711]: INFO nova.virt.block_device [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Attempting to driver detach volume 34023a39-bbf4-4afb-948b-0bff9f563bb8 from mountpoint /dev/vdb
Apr 12 06:27:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Attempting to detach device vdb from instance 7dee97a4-9497-43c2-a688-7bedd1441885 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:27:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:27:31 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:27:31 user nova-compute[71711]:   <source dev="/dev/sde"/>
Apr 12 06:27:31 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:27:31 user nova-compute[71711]:   <serial>34023a39-bbf4-4afb-948b-0bff9f563bb8</serial>
Apr 12 06:27:31 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 06:27:31 user nova-compute[71711]: </disk>
Apr 12 06:27:31 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:27:31 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully detached device vdb from instance 7dee97a4-9497-43c2-a688-7bedd1441885 from the persistent domain config.
Apr 12 06:27:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7dee97a4-9497-43c2-a688-7bedd1441885 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:27:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:27:31 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:27:31 user nova-compute[71711]:   <source dev="/dev/sde"/>
Apr 12 06:27:31 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:27:31 user nova-compute[71711]:   <serial>34023a39-bbf4-4afb-948b-0bff9f563bb8</serial>
Apr 12 06:27:31 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 06:27:31 user nova-compute[71711]: </disk>
Apr 12 06:27:31 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681280852.1557825, 7dee97a4-9497-43c2-a688-7bedd1441885 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:27:32 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully detached device vdb from instance 7dee97a4-9497-43c2-a688-7bedd1441885 from the live domain config.
Apr 12 06:27:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmJGqRkQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:27:32 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d774a1-6980-4e3f-bcfb-7d2844c50cd2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:27:32 user nova-compute[71711]: No targets found.
Apr 12 06:27:32 user nova-compute[71711]: iSNS:
Apr 12 06:27:32 user nova-compute[71711]: No targets found.
Apr 12 06:27:32 user nova-compute[71711]: STATIC:
Apr 12 06:27:32 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8
Apr 12 06:27:32 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:32 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:32 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:27:32 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:32 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:32 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975
Apr 12 06:27:32 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:32 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:32 user nova-compute[71711]: FIRMWARE:
Apr 12 06:27:32 user nova-compute[71711]: No targets found.
Apr 12 06:27:32 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:27:32 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:27:32 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8779b2f-bf8d-44cf-8299-1a9ecc15862f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2094c01e-29b7-483a-9340-da937bc06377]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:27:32 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:32 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:32 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 (non-flash)
Apr 12 06:27:32 user nova-compute[71711]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:32 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:32 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9961f3a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8'): ({'sde'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Removing single pathed devices sde {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ab4975-e0ca-4809-88b7-e3f153a20bac]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da522b0-6b1d-483e-85d8-e92619520286]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flushing IO for device /dev/sde {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8773e82d-987b-4290-afa9-2daee427f212]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f37d932-dbaa-4f8d-a523-7fa32b495899]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] SCSI volumes sde have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[87448792-a80c-4401-ac07-c428495b56e1]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2efe3ec-260b-4a72-aeac-89155f6c2917]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260]
Apr 12 06:27:32 user nova-compute[71711]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8, portal: 172.16.0.220,3260] successful.
Apr 12 06:27:32 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34023a39-bbf4-4afb-948b-0bff9f563bb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3906bdc8-3ac0-45f7-9548-7575f0489375]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] <== disconnect_volume: return (274ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:27:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:27:33 user nova-compute[71711]: DEBUG nova.objects.instance [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'flavor' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:27:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-35ae0c10-f0d6-4de3-a220-3e201e9eede2 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.699s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca0f5ca0-29e1-480e-9138-f2d4e4d9fa92 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca0f5ca0-29e1-480e-9138-f2d4e4d9fa92 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:33 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ca0f5ca0-29e1-480e-9138-f2d4e4d9fa92 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:27:33 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ca0f5ca0-29e1-480e-9138-f2d4e4d9fa92 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71711) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 06:27:33 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ca0f5ca0-29e1-480e-9138-f2d4e4d9fa92 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'flavor' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:27:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-34403753-64e7-4d3e-be31-a246b09f6235 req-6d1e5eda-604d-4c7a-b323-9c342e3b898e service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-unplugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-34403753-64e7-4d3e-be31-a246b09f6235 req-6d1e5eda-604d-4c7a-b323-9c342e3b898e service nova] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-34403753-64e7-4d3e-be31-a246b09f6235 req-6d1e5eda-604d-4c7a-b323-9c342e3b898e service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-34403753-64e7-4d3e-be31-a246b09f6235 req-6d1e5eda-604d-4c7a-b323-9c342e3b898e service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-34403753-64e7-4d3e-be31-a246b09f6235 req-6d1e5eda-604d-4c7a-b323-9c342e3b898e service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] No waiting events found dispatching network-vif-unplugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:34 user nova-compute[71711]: WARNING nova.compute.manager [req-34403753-64e7-4d3e-be31-a246b09f6235 req-6d1e5eda-604d-4c7a-b323-9c342e3b898e service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received unexpected event network-vif-unplugged-1e69d862-c01c-48c7-8795-00233f9e7812 for instance with vm_state active and task_state powering-off.
Apr 12 06:27:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:34 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Instance destroyed successfully.
Apr 12 06:27:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ca0f5ca0-29e1-480e-9138-f2d4e4d9fa92 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:27:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ca0f5ca0-29e1-480e-9138-f2d4e4d9fa92 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.835s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:36 user nova-compute[71711]: DEBUG nova.compute.manager [req-3ba6091a-ac09-40f6-933b-46905dbd2255 req-e85ad87b-1dca-4b19-ac21-c90667886c60 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3ba6091a-ac09-40f6-933b-46905dbd2255 req-e85ad87b-1dca-4b19-ac21-c90667886c60 service nova] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3ba6091a-ac09-40f6-933b-46905dbd2255 req-e85ad87b-1dca-4b19-ac21-c90667886c60 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3ba6091a-ac09-40f6-933b-46905dbd2255 req-e85ad87b-1dca-4b19-ac21-c90667886c60 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:36 user nova-compute[71711]: DEBUG nova.compute.manager [req-3ba6091a-ac09-40f6-933b-46905dbd2255 req-e85ad87b-1dca-4b19-ac21-c90667886c60 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] No waiting events found dispatching network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:36 user nova-compute[71711]: WARNING nova.compute.manager [req-3ba6091a-ac09-40f6-933b-46905dbd2255 req-e85ad87b-1dca-4b19-ac21-c90667886c60 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received unexpected event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 for instance with vm_state stopped and task_state None.
Apr 12 06:27:37 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:39 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:39 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71711) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 06:27:41 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:42 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:42 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:42 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:42 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:42 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:27:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Received event network-changed-491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Refreshing instance network info cache due to event network-changed-491bd5ef-7e10-49f3-ae6e-3804489ade6f. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:27:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] Acquiring lock "refresh_cache-adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:27:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] Acquired lock "refresh_cache-adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:27:43 user nova-compute[71711]: DEBUG nova.network.neutron [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Refreshing network info cache for port 491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:27:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:43 user nova-compute[71711]: DEBUG nova.objects.instance [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'flavor' on Instance uuid adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:27:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:44 user nova-compute[71711]: INFO nova.compute.manager [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Attaching volume ff8cf913-7198-47e1-adda-fe9fff61c36b to /dev/vdb
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG os_brick.utils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dfb616-4ecd-4eab-908f-eafcdccf494e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a934ff0d-156d-4d9b-8914-967973da4eb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[973a07c5-504c-4504-a992-f2c848b212cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c8c009-c6eb-4d24-bdb2-1c316ef4c04a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:27:44 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[76245407-ee4e-4266-a9bf-7b50fa98cd57]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG nova.network.neutron [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Updated VIF entry in instance network info cache for port 491bd5ef-7e10-49f3-ae6e-3804489ade6f. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG nova.network.neutron [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Updating instance_info_cache with network_info: [{"id": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "address": "fa:16:3e:c0:49:12", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491bd5ef-7e", "ovs_interfaceid": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG os_brick.utils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Updating existing volume attachment record: 15f5189b-bd1f-4810-88b1-d2363abe51ca {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-05674644-bddd-4ce7-9840-c3cc5f2a7f12 req-0e110087-0860-4283-b8dd-e50990a8cf19 service nova] Releasing lock "refresh_cache-adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updating instance_info_cache with network_info: [{"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:27:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:27:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:27:47 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:27:47 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:27:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=26.35366439819336GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:27:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7dee97a4-9497-43c2-a688-7bedd1441885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance a528e600-7358-4b92-9b71-12759f405b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance d78558e6-437e-44dd-b6b4-123ed3447094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing inventories for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating ProviderTree inventory for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating inventory in ProviderTree for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing aggregate associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, aggregates: None {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing trait associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, traits: HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSFTbZuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:27:48 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:27:48 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:27:48 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad7a79a-747c-4ef7-b460-03145502b7c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:27:48 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e67de7c-9ffb-4210-ba3c-db188f8ef896]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b] added
Apr 12 06:27:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdb1c17-0e43-45a4-8c2e-da6503ca9663]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e007add6-b737-4c45-897a-a975c1016bc5]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSFTbZuW {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSFTbZuW" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[328e3ab2-8feb-4e8b-b4fa-f43bab661fed]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kSFTbZuW'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae712aa-f631-4438-96b7-2b67bc444f8e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.692s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35e836a-25b3-4371-8c92-edd176009af7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:48 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:48 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] There are 0 instances to clean {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a12779-0797-4632-8907-79a9dbd0ade5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b, portal: 172.16.0.220,3260]
Apr 12 06:27:48 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b, portal: 172.16.0.220,3260] successful.
Apr 12 06:27:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0bf35b-91ea-4204-b678-3a2da7b904e8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e1911-23d0-476d-8f32-041280fc1dde]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:48 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:48 user nova-compute[71711]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b (non-flash)
Apr 12 06:27:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:48 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:48 user nova-compute[71711]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b (non-flash)
Apr 12 06:27:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1b6a6d-a57f-49c3-a3ce-763b304eee93]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSFTbZuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:27:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:49 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280854.7622354, 7dee97a4-9497-43c2-a688-7bedd1441885 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:27:49 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] VM Stopped (Lifecycle Event)
Apr 12 06:27:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-da2f7ffc-85ec-45d9-96af-0ebba3ccccfe None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:27:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-da2f7ffc-85ec-45d9-96af-0ebba3ccccfe None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:27:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:27:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23530643461656266', 'path': '/dev/sdb'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:27:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530643461656266', 'path': '/dev/sdb'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:27:49 user nova-compute[71711]: DEBUG nova.objects.instance [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'flavor' on Instance uuid adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:27:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:27:49 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:27:49 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:27:49 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:27:49 user nova-compute[71711]:   <serial>ff8cf913-7198-47e1-adda-fe9fff61c36b</serial>
Apr 12 06:27:49 user nova-compute[71711]: </disk>
Apr 12 06:27:49 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:27:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:27:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:27:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] No VIF found with MAC fa:16:3e:c0:49:12, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:27:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cb016b33-298f-42f9-90ac-6ffaea4373d8 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.323s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:51 user nova-compute[71711]: INFO nova.compute.manager [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Detaching volume ff8cf913-7198-47e1-adda-fe9fff61c36b
Apr 12 06:27:51 user nova-compute[71711]: INFO nova.virt.block_device [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Attempting to driver detach volume ff8cf913-7198-47e1-adda-fe9fff61c36b from mountpoint /dev/vdb
Apr 12 06:27:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Attempting to detach device vdb from instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:27:51 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:27:51 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:27:51 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:27:51 user nova-compute[71711]:   <serial>ff8cf913-7198-47e1-adda-fe9fff61c36b</serial>
Apr 12 06:27:51 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:27:51 user nova-compute[71711]: </disk>
Apr 12 06:27:51 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:27:51 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Successfully detached device vdb from instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf from the persistent domain config.
Apr 12 06:27:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:27:51 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:27:51 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:27:51 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:27:51 user nova-compute[71711]:   <serial>ff8cf913-7198-47e1-adda-fe9fff61c36b</serial>
Apr 12 06:27:51 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:27:51 user nova-compute[71711]: </disk>
Apr 12 06:27:51 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681280871.5662327, adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:27:51 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Successfully detached device vdb from instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf from the live domain config.
Apr 12 06:27:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSFTbZuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:27:51 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa1b9d9-9132-4375-b760-75199351676b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:27:51 user nova-compute[71711]: No targets found.
Apr 12 06:27:51 user nova-compute[71711]: iSNS:
Apr 12 06:27:51 user nova-compute[71711]: No targets found.
Apr 12 06:27:51 user nova-compute[71711]: STATIC:
Apr 12 06:27:51 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:27:51 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:51 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:51 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b
Apr 12 06:27:51 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:51 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:51 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975
Apr 12 06:27:51 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:27:51 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:27:51 user nova-compute[71711]: FIRMWARE:
Apr 12 06:27:51 user nova-compute[71711]: No targets found.
Apr 12 06:27:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:27:51 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:27:51 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea55634d-a4f9-47d3-a2c5-35b03c44c7ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b5ad99-1c4f-4f60-bc82-8739a851d5c3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:51 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:51 user nova-compute[71711]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b (non-flash)
Apr 12 06:27:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:27:51 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:27:51 user nova-compute[71711]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b (non-flash)
Apr 12 06:27:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9961e12710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b'): ({'sdb'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Removing single pathed devices sdb {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a34ac9d-6356-4b84-979c-cecdfbe18152]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c6e41f-d36b-48b4-951e-fbc70d6dd2f8]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Flushing IO for device /dev/sdb {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d2cc2a-8f82-4318-9dd1-a25fb0eb02bf]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed4fbe7-78ee-4d10-8881-874f0b85d32f]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fcefc8-a16c-44f2-a5d5-c41464a89d00]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9292b789-d298-4559-b837-8fbca892b994]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b, portal: 172.16.0.220,3260]
Apr 12 06:27:51 user nova-compute[71711]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b, portal: 172.16.0.220,3260] successful.
Apr 12 06:27:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff8cf913-7198-47e1-adda-fe9fff61c36b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f28596-6f18-47ce-9d47-faab00c6effd]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] <== disconnect_volume: return (307ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:27:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:27:52 user nova-compute[71711]: DEBUG nova.objects.instance [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'flavor' on Instance uuid adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:27:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-44811260-e1d1-44d6-820a-920c5c457e7c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.725s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:54 user nova-compute[71711]: INFO nova.compute.manager [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Terminating instance
Apr 12 06:27:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:27:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-bd61437e-5fc2-4d6b-8527-8cefb37b8950 req-292ae9d1-8c83-45ac-847a-8d36f3a75c41 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Received event network-vif-unplugged-f4d18025-6c85-4429-9b5a-59724be47184 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bd61437e-5fc2-4d6b-8527-8cefb37b8950 req-292ae9d1-8c83-45ac-847a-8d36f3a75c41 service nova] Acquiring lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bd61437e-5fc2-4d6b-8527-8cefb37b8950 req-292ae9d1-8c83-45ac-847a-8d36f3a75c41 service nova] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bd61437e-5fc2-4d6b-8527-8cefb37b8950 req-292ae9d1-8c83-45ac-847a-8d36f3a75c41 service nova] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-bd61437e-5fc2-4d6b-8527-8cefb37b8950 req-292ae9d1-8c83-45ac-847a-8d36f3a75c41 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] No waiting events found dispatching network-vif-unplugged-f4d18025-6c85-4429-9b5a-59724be47184 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-bd61437e-5fc2-4d6b-8527-8cefb37b8950 req-292ae9d1-8c83-45ac-847a-8d36f3a75c41 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Received event network-vif-unplugged-f4d18025-6c85-4429-9b5a-59724be47184 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:27:55 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Instance destroyed successfully.
Apr 12 06:27:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lazy-loading 'resources' on Instance uuid 0a0f5f93-3d0f-483c-b467-63b83db9cce1 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:25:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-431102723',display_name='tempest-VolumesActionsTest-instance-431102723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-431102723',id=14,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:26:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d92928c7a0ed463bbd9020808578b263',ramdisk_id='',reservation_id='r-a4wmu02v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-190731565',owner_user_name='tempest-VolumesActionsTest-190731565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:26:09Z,user_data=None,user_id='13f5402fd38f40c08c30991ad78b7f58',uuid=0a0f5f93-3d0f-483c-b467-63b83db9cce1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4d18025-6c85-4429-9b5a-59724be47184", "address": "fa:16:3e:05:e5:aa", "network": {"id": "3e68bc36-acaf-40c8-983d-8bd288d82224", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1852763740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d92928c7a0ed463bbd9020808578b263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d18025-6c", "ovs_interfaceid": "f4d18025-6c85-4429-9b5a-59724be47184", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Converting VIF {"id": "f4d18025-6c85-4429-9b5a-59724be47184", "address": "fa:16:3e:05:e5:aa", "network": {"id": "3e68bc36-acaf-40c8-983d-8bd288d82224", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1852763740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d92928c7a0ed463bbd9020808578b263", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d18025-6c", "ovs_interfaceid": "f4d18025-6c85-4429-9b5a-59724be47184", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=f4d18025-6c85-4429-9b5a-59724be47184,network=Network(3e68bc36-acaf-40c8-983d-8bd288d82224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d18025-6c') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG os_vif [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=f4d18025-6c85-4429-9b5a-59724be47184,network=Network(3e68bc36-acaf-40c8-983d-8bd288d82224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d18025-6c') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4d18025-6c, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:27:55 user nova-compute[71711]: INFO os_vif [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=f4d18025-6c85-4429-9b5a-59724be47184,network=Network(3e68bc36-acaf-40c8-983d-8bd288d82224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d18025-6c')
Apr 12 06:27:55 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Deleting instance files /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1_del
Apr 12 06:27:55 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Deletion of /opt/stack/data/nova/instances/0a0f5f93-3d0f-483c-b467-63b83db9cce1_del complete
Apr 12 06:27:55 user nova-compute[71711]: INFO nova.compute.manager [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 06:27:55 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:27:55 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:27:56 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:27:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-d00a297c-068a-46e1-b399-b020f58375b4 req-9607009c-ed6b-491d-a0cb-d5b92e218ae9 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Received event network-vif-deleted-f4d18025-6c85-4429-9b5a-59724be47184 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:56 user nova-compute[71711]: INFO nova.compute.manager [req-d00a297c-068a-46e1-b399-b020f58375b4 req-9607009c-ed6b-491d-a0cb-d5b92e218ae9 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Neutron deleted interface f4d18025-6c85-4429-9b5a-59724be47184; detaching it from the instance and deleting it from the info cache
Apr 12 06:27:56 user nova-compute[71711]: DEBUG nova.network.neutron [req-d00a297c-068a-46e1-b399-b020f58375b4 req-9607009c-ed6b-491d-a0cb-d5b92e218ae9 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:27:56 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Took 0.46 seconds to deallocate network for instance.
Apr 12 06:27:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-d00a297c-068a-46e1-b399-b020f58375b4 req-9607009c-ed6b-491d-a0cb-d5b92e218ae9 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Detach interface failed, port_id=f4d18025-6c85-4429-9b5a-59724be47184, reason: Instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1 could not be found. {{(pid=71711) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 06:27:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:56 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:27:56 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:27:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:56 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Deleted allocations for instance 0a0f5f93-3d0f-483c-b467-63b83db9cce1
Apr 12 06:27:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-6f6da03a-fccc-4183-a3eb-3b8248d3232c tempest-VolumesActionsTest-190731565 tempest-VolumesActionsTest-190731565-project-member] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.819s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:57 user nova-compute[71711]: DEBUG nova.compute.manager [req-669530c0-660f-4a42-ac43-03081a2b67c9 req-39227cc4-5dd2-4114-8f2a-a920a3c0de78 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Received event network-vif-plugged-f4d18025-6c85-4429-9b5a-59724be47184 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:27:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-669530c0-660f-4a42-ac43-03081a2b67c9 req-39227cc4-5dd2-4114-8f2a-a920a3c0de78 service nova] Acquiring lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:27:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-669530c0-660f-4a42-ac43-03081a2b67c9 req-39227cc4-5dd2-4114-8f2a-a920a3c0de78 service nova] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:27:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-669530c0-660f-4a42-ac43-03081a2b67c9 req-39227cc4-5dd2-4114-8f2a-a920a3c0de78 service nova] Lock "0a0f5f93-3d0f-483c-b467-63b83db9cce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:27:57 user nova-compute[71711]: DEBUG nova.compute.manager [req-669530c0-660f-4a42-ac43-03081a2b67c9 req-39227cc4-5dd2-4114-8f2a-a920a3c0de78 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] No waiting events found dispatching network-vif-plugged-f4d18025-6c85-4429-9b5a-59724be47184 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:27:57 user nova-compute[71711]: WARNING nova.compute.manager [req-669530c0-660f-4a42-ac43-03081a2b67c9 req-39227cc4-5dd2-4114-8f2a-a920a3c0de78 service nova] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Received unexpected event network-vif-plugged-f4d18025-6c85-4429-9b5a-59724be47184 for instance with vm_state deleted and task_state None.
Apr 12 06:27:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:10 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280875.4857597, 0a0f5f93-3d0f-483c-b467-63b83db9cce1 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:28:10 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] VM Stopped (Lifecycle Event)
Apr 12 06:28:10 user nova-compute[71711]: DEBUG nova.compute.manager [None req-47ac871f-def4-423e-8b3a-37a68e9facd7 None None] [instance: 0a0f5f93-3d0f-483c-b467-63b83db9cce1] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:28:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:28:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:28:14 user nova-compute[71711]: INFO nova.compute.manager [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] instance snapshotting
Apr 12 06:28:14 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Beginning live snapshot process
Apr 12 06:28:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json -f qcow2 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json -f qcow2 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4icismpa/0521f1efd82842919c36840151fb39fa.delta 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4icismpa/0521f1efd82842919c36840151fb39fa.delta 1073741824" returned: 0 in 0.051s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:15 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 06:28:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:28:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:28:16 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 06:28:16 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:28:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4icismpa/0521f1efd82842919c36840151fb39fa.delta /opt/stack/data/nova/instances/snapshots/tmp4icismpa/0521f1efd82842919c36840151fb39fa {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4icismpa/0521f1efd82842919c36840151fb39fa.delta /opt/stack/data/nova/instances/snapshots/tmp4icismpa/0521f1efd82842919c36840151fb39fa" returned: 0 in 0.190s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:16 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Snapshot extracted, beginning image upload
Apr 12 06:28:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:19 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Snapshot image upload complete
Apr 12 06:28:19 user nova-compute[71711]: INFO nova.compute.manager [None req-a55f8f78-40b1-4f5d-a34d-810edbd7e834 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Took 4.50 seconds to snapshot the instance on the hypervisor.
Apr 12 06:28:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 46b32f3f-86c4-450a-a710-7d0c05ea4097 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid a528e600-7358-4b92-9b71-12759f405b38 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 7141c80d-34a9-40cc-a792-b01ffd9155b6 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 0a6c87b7-75d7-429e-9f7b-e8a959f1791f {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid d78558e6-437e-44dd-b6b4-123ed3447094 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "46b32f3f-86c4-450a-a710-7d0c05ea4097" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "a528e600-7358-4b92-9b71-12759f405b38" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "a528e600-7358-4b92-9b71-12759f405b38" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "d78558e6-437e-44dd-b6b4-123ed3447094" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "d78558e6-437e-44dd-b6b4-123ed3447094" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "a528e600-7358-4b92-9b71-12759f405b38" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "d78558e6-437e-44dd-b6b4-123ed3447094" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "5364688b-cc08-4407-94f5-974846ae7bb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:28:27 user nova-compute[71711]: INFO nova.compute.claims [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Claim successful on node user
Apr 12 06:28:27 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:28:27 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:28:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG nova.policy [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "c64aff93-15fa-4520-b6ac-cdcacb49478e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:28:27 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Creating image(s)
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "/opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "/opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "/opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:28:27 user nova-compute[71711]: INFO nova.compute.claims [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Claim successful on node user
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.155s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk 1073741824" returned: 0 in 0.050s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.145s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Successfully created port: 92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Cannot resize image /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.objects.instance [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'migration_context' on Instance uuid 5364688b-cc08-4407-94f5-974846ae7bb8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Ensure instance console log exists: /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:28:28 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.policy [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:28:28 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Creating image(s)
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "/opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "/opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "/opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk 1073741824" returned: 0 in 0.050s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Successfully updated port: 92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquired lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-changed-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Refreshing instance network info cache due to event network-changed-92e5c952-1e00-4dde-8dcc-dc876149d896. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] Acquiring lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:28:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.network.neutron [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Successfully created port: 6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Cannot resize image /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.objects.instance [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'migration_context' on Instance uuid c64aff93-15fa-4520-b6ac-cdcacb49478e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Ensure instance console log exists: /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Updating instance_info_cache with network_info: [{"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Releasing lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Instance network_info: |[{"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] Acquired lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.network.neutron [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Refreshing network info cache for port 92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Start _get_guest_xml network_info=[{"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:28:29 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:28:29 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-457399220',display_name='tempest-ServerRescueNegativeTestJSON-server-457399220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-457399220',id=17,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='972842dc32ee4687866dfe2fbefe9cb4',ramdisk_id='',reservation_id='r-042stp6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1179647693',owner_user_name='tempest-ServerRescueNegativeTestJSON-1179647693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:28:28Z,user_data=None,user_id='dc8e6af1db834409a4880040a5ef6a5a',uuid=5364688b-cc08-4407-94f5-974846ae7bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converting VIF {"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=92e5c952-1e00-4dde-8dcc-dc876149d896,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e5c952-1e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.objects.instance [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'pci_devices' on Instance uuid 5364688b-cc08-4407-94f5-974846ae7bb8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:28:29 user nova-compute[71711]:   <uuid>5364688b-cc08-4407-94f5-974846ae7bb8</uuid>
Apr 12 06:28:29 user nova-compute[71711]:   <name>instance-00000011</name>
Apr 12 06:28:29 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:28:29 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:28:29 user nova-compute[71711]:   <metadata>
Apr 12 06:28:29 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:28:29 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:28:29 user nova-compute[71711]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-457399220</nova:name>
Apr 12 06:28:29 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:28:29</nova:creationTime>
Apr 12 06:28:29 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:28:29 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:28:29 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:28:29 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:28:29 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:28:29 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:28:29 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:28:29 user nova-compute[71711]:       <nova:owner>
Apr 12 06:28:29 user nova-compute[71711]:         <nova:user uuid="dc8e6af1db834409a4880040a5ef6a5a">tempest-ServerRescueNegativeTestJSON-1179647693-project-member</nova:user>
Apr 12 06:28:29 user nova-compute[71711]:         <nova:project uuid="972842dc32ee4687866dfe2fbefe9cb4">tempest-ServerRescueNegativeTestJSON-1179647693</nova:project>
Apr 12 06:28:29 user nova-compute[71711]:       </nova:owner>
Apr 12 06:28:29 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:28:29 user nova-compute[71711]:       <nova:ports>
Apr 12 06:28:29 user nova-compute[71711]:         <nova:port uuid="92e5c952-1e00-4dde-8dcc-dc876149d896">
Apr 12 06:28:29 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 06:28:29 user nova-compute[71711]:         </nova:port>
Apr 12 06:28:29 user nova-compute[71711]:       </nova:ports>
Apr 12 06:28:29 user nova-compute[71711]:     </nova:instance>
Apr 12 06:28:29 user nova-compute[71711]:   </metadata>
Apr 12 06:28:29 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:28:29 user nova-compute[71711]:     <system>
Apr 12 06:28:29 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:28:29 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:28:29 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:28:29 user nova-compute[71711]:       <entry name="serial">5364688b-cc08-4407-94f5-974846ae7bb8</entry>
Apr 12 06:28:29 user nova-compute[71711]:       <entry name="uuid">5364688b-cc08-4407-94f5-974846ae7bb8</entry>
Apr 12 06:28:29 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:28:29 user nova-compute[71711]:     </system>
Apr 12 06:28:29 user nova-compute[71711]:   </sysinfo>
Apr 12 06:28:29 user nova-compute[71711]:   <os>
Apr 12 06:28:29 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:28:29 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:28:29 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:28:29 user nova-compute[71711]:   </os>
Apr 12 06:28:29 user nova-compute[71711]:   <features>
Apr 12 06:28:29 user nova-compute[71711]:     <acpi/>
Apr 12 06:28:29 user nova-compute[71711]:     <apic/>
Apr 12 06:28:29 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:28:29 user nova-compute[71711]:   </features>
Apr 12 06:28:29 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:28:29 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:28:29 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:28:29 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:28:29 user nova-compute[71711]:   </clock>
Apr 12 06:28:29 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:28:29 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:28:29 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:28:29 user nova-compute[71711]:   </cpu>
Apr 12 06:28:29 user nova-compute[71711]:   <devices>
Apr 12 06:28:29 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:28:29 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:28:29 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk"/>
Apr 12 06:28:29 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:28:29 user nova-compute[71711]:     </disk>
Apr 12 06:28:29 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:28:29 user nova-compute[71711]:       <mac address="fa:16:3e:42:29:c8"/>
Apr 12 06:28:29 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:28:29 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:28:29 user nova-compute[71711]:       <target dev="tap92e5c952-1e"/>
Apr 12 06:28:29 user nova-compute[71711]:     </interface>
Apr 12 06:28:29 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:28:29 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/console.log" append="off"/>
Apr 12 06:28:29 user nova-compute[71711]:     </serial>
Apr 12 06:28:29 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:28:29 user nova-compute[71711]:     <video>
Apr 12 06:28:29 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:28:29 user nova-compute[71711]:     </video>
Apr 12 06:28:29 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:28:29 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:28:29 user nova-compute[71711]:     </rng>
Apr 12 06:28:29 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:28:29 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:28:29 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:28:29 user nova-compute[71711]:     </memballoon>
Apr 12 06:28:29 user nova-compute[71711]:   </devices>
Apr 12 06:28:29 user nova-compute[71711]: </domain>
Apr 12 06:28:29 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-457399220',display_name='tempest-ServerRescueNegativeTestJSON-server-457399220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-457399220',id=17,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='972842dc32ee4687866dfe2fbefe9cb4',ramdisk_id='',reservation_id='r-042stp6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1179647693',owner_user_name='tempest-ServerRescueNegativeTestJSON-1179647693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:28:28Z,user_data=None,user_id='dc8e6af1db834409a4880040a5ef6a5a',uuid=5364688b-cc08-4407-94f5-974846ae7bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converting VIF {"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=92e5c952-1e00-4dde-8dcc-dc876149d896,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e5c952-1e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG os_vif [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=92e5c952-1e00-4dde-8dcc-dc876149d896,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e5c952-1e') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92e5c952-1e, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap92e5c952-1e, col_values=(('external_ids', {'iface-id': '92e5c952-1e00-4dde-8dcc-dc876149d896', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:29:c8', 'vm-uuid': '5364688b-cc08-4407-94f5-974846ae7bb8'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:29 user nova-compute[71711]: INFO os_vif [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=92e5c952-1e00-4dde-8dcc-dc876149d896,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e5c952-1e')
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No VIF found with MAC fa:16:3e:42:29:c8, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.network.neutron [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Successfully updated port: 6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquired lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.network.neutron [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received event network-changed-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Refreshing instance network info cache due to event network-changed-6649e98a-d7bc-4e7a-ab8b-d00622606a3b. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] Acquiring lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:28:29 user nova-compute[71711]: DEBUG nova.network.neutron [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.network.neutron [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Updated VIF entry in instance network info cache for port 92e5c952-1e00-4dde-8dcc-dc876149d896. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.network.neutron [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Updating instance_info_cache with network_info: [{"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0eadb179-4a79-4e3f-8988-608815784ee7 req-e2d2c5ab-90f8-44cc-a1e6-ee76a37c4e90 service nova] Releasing lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.network.neutron [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Updating instance_info_cache with network_info: [{"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Releasing lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Instance network_info: |[{"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] Acquired lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.network.neutron [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Refreshing network info cache for port 6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Start _get_guest_xml network_info=[{"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:28:30 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:28:30 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-335972391',display_name='tempest-ServerRescueNegativeTestJSON-server-335972391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-335972391',id=18,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='972842dc32ee4687866dfe2fbefe9cb4',ramdisk_id='',reservation_id='r-dv6aie1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1179647693',owner_user_name='tempest-ServerRescueNegativeTestJSON-1179647693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:28:28Z,user_data=None,user_id='dc8e6af1db834409a4880040a5ef6a5a',uuid=c64aff93-15fa-4520-b6ac-cdcacb49478e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converting VIF {"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:30:50,bridge_name='br-int',has_traffic_filtering=True,id=6649e98a-d7bc-4e7a-ab8b-d00622606a3b,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6649e98a-d7') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.objects.instance [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'pci_devices' on Instance uuid c64aff93-15fa-4520-b6ac-cdcacb49478e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:28:30 user nova-compute[71711]:   <uuid>c64aff93-15fa-4520-b6ac-cdcacb49478e</uuid>
Apr 12 06:28:30 user nova-compute[71711]:   <name>instance-00000012</name>
Apr 12 06:28:30 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:28:30 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:28:30 user nova-compute[71711]:   <metadata>
Apr 12 06:28:30 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:28:30 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:28:30 user nova-compute[71711]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-335972391</nova:name>
Apr 12 06:28:30 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:28:30</nova:creationTime>
Apr 12 06:28:30 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:28:30 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:28:30 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:28:30 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:28:30 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:28:30 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:28:30 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:28:30 user nova-compute[71711]:       <nova:owner>
Apr 12 06:28:30 user nova-compute[71711]:         <nova:user uuid="dc8e6af1db834409a4880040a5ef6a5a">tempest-ServerRescueNegativeTestJSON-1179647693-project-member</nova:user>
Apr 12 06:28:30 user nova-compute[71711]:         <nova:project uuid="972842dc32ee4687866dfe2fbefe9cb4">tempest-ServerRescueNegativeTestJSON-1179647693</nova:project>
Apr 12 06:28:30 user nova-compute[71711]:       </nova:owner>
Apr 12 06:28:30 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:28:30 user nova-compute[71711]:       <nova:ports>
Apr 12 06:28:30 user nova-compute[71711]:         <nova:port uuid="6649e98a-d7bc-4e7a-ab8b-d00622606a3b">
Apr 12 06:28:30 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 06:28:30 user nova-compute[71711]:         </nova:port>
Apr 12 06:28:30 user nova-compute[71711]:       </nova:ports>
Apr 12 06:28:30 user nova-compute[71711]:     </nova:instance>
Apr 12 06:28:30 user nova-compute[71711]:   </metadata>
Apr 12 06:28:30 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:28:30 user nova-compute[71711]:     <system>
Apr 12 06:28:30 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:28:30 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:28:30 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:28:30 user nova-compute[71711]:       <entry name="serial">c64aff93-15fa-4520-b6ac-cdcacb49478e</entry>
Apr 12 06:28:30 user nova-compute[71711]:       <entry name="uuid">c64aff93-15fa-4520-b6ac-cdcacb49478e</entry>
Apr 12 06:28:30 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:28:30 user nova-compute[71711]:     </system>
Apr 12 06:28:30 user nova-compute[71711]:   </sysinfo>
Apr 12 06:28:30 user nova-compute[71711]:   <os>
Apr 12 06:28:30 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:28:30 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:28:30 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:28:30 user nova-compute[71711]:   </os>
Apr 12 06:28:30 user nova-compute[71711]:   <features>
Apr 12 06:28:30 user nova-compute[71711]:     <acpi/>
Apr 12 06:28:30 user nova-compute[71711]:     <apic/>
Apr 12 06:28:30 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:28:30 user nova-compute[71711]:   </features>
Apr 12 06:28:30 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:28:30 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:28:30 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:28:30 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:28:30 user nova-compute[71711]:   </clock>
Apr 12 06:28:30 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:28:30 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:28:30 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:28:30 user nova-compute[71711]:   </cpu>
Apr 12 06:28:30 user nova-compute[71711]:   <devices>
Apr 12 06:28:30 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:28:30 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:28:30 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk"/>
Apr 12 06:28:30 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:28:30 user nova-compute[71711]:     </disk>
Apr 12 06:28:30 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:28:30 user nova-compute[71711]:       <mac address="fa:16:3e:92:30:50"/>
Apr 12 06:28:30 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:28:30 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:28:30 user nova-compute[71711]:       <target dev="tap6649e98a-d7"/>
Apr 12 06:28:30 user nova-compute[71711]:     </interface>
Apr 12 06:28:30 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:28:30 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/console.log" append="off"/>
Apr 12 06:28:30 user nova-compute[71711]:     </serial>
Apr 12 06:28:30 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:28:30 user nova-compute[71711]:     <video>
Apr 12 06:28:30 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:28:30 user nova-compute[71711]:     </video>
Apr 12 06:28:30 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:28:30 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:28:30 user nova-compute[71711]:     </rng>
Apr 12 06:28:30 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:28:30 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:28:30 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:28:30 user nova-compute[71711]:     </memballoon>
Apr 12 06:28:30 user nova-compute[71711]:   </devices>
Apr 12 06:28:30 user nova-compute[71711]: </domain>
Apr 12 06:28:30 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-335972391',display_name='tempest-ServerRescueNegativeTestJSON-server-335972391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-335972391',id=18,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='972842dc32ee4687866dfe2fbefe9cb4',ramdisk_id='',reservation_id='r-dv6aie1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1179647693',owner_user_name='tempest-ServerRescueNegativeTestJSON-1179647693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:28:28Z,user_data=None,user_id='dc8e6af1db834409a4880040a5ef6a5a',uuid=c64aff93-15fa-4520-b6ac-cdcacb49478e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converting VIF {"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:30:50,bridge_name='br-int',has_traffic_filtering=True,id=6649e98a-d7bc-4e7a-ab8b-d00622606a3b,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6649e98a-d7') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG os_vif [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:30:50,bridge_name='br-int',has_traffic_filtering=True,id=6649e98a-d7bc-4e7a-ab8b-d00622606a3b,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6649e98a-d7') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6649e98a-d7, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6649e98a-d7, col_values=(('external_ids', {'iface-id': '6649e98a-d7bc-4e7a-ab8b-d00622606a3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:30:50', 'vm-uuid': 'c64aff93-15fa-4520-b6ac-cdcacb49478e'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:30 user nova-compute[71711]: INFO os_vif [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:30:50,bridge_name='br-int',has_traffic_filtering=True,id=6649e98a-d7bc-4e7a-ab8b-d00622606a3b,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6649e98a-d7')
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No VIF found with MAC fa:16:3e:92:30:50, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.network.neutron [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Updated VIF entry in instance network info cache for port 6649e98a-d7bc-4e7a-ab8b-d00622606a3b. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG nova.network.neutron [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Updating instance_info_cache with network_info: [{"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:28:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8b5a0553-a31c-4b9e-ab78-16711c6d1d73 req-a5f24d17-5004-468e-89e5-3a92daf16414 service nova] Releasing lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG nova.compute.manager [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG nova.compute.manager [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] No waiting events found dispatching network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:28:31 user nova-compute[71711]: WARNING nova.compute.manager [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received unexpected event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 for instance with vm_state building and task_state spawning.
Apr 12 06:28:31 user nova-compute[71711]: DEBUG nova.compute.manager [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:31 user nova-compute[71711]: DEBUG nova.compute.manager [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] No waiting events found dispatching network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:28:31 user nova-compute[71711]: WARNING nova.compute.manager [req-c8866670-1d92-42fa-a634-fcef004c7cea req-e86f5104-b7a2-4b7c-9568-522e557b28d7 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received unexpected event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 for instance with vm_state building and task_state spawning.
Apr 12 06:28:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received event network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] Acquiring lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] No waiting events found dispatching network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:28:33 user nova-compute[71711]: WARNING nova.compute.manager [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received unexpected event network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance with vm_state building and task_state spawning.
Apr 12 06:28:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received event network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] Acquiring lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] No waiting events found dispatching network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:28:33 user nova-compute[71711]: WARNING nova.compute.manager [req-294cf7cf-b506-4da2-b144-dda89e9d2501 req-f57ede84-4517-4b71-90bf-55aa285d94b3 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received unexpected event network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance with vm_state building and task_state spawning.
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280914.398304, 5364688b-cc08-4407-94f5-974846ae7bb8 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:28:34 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] VM Resumed (Lifecycle Event)
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:28:34 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Instance spawned successfully.
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:28:34 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Instance spawned successfully.
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:28:34 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280914.4002206, 5364688b-cc08-4407-94f5-974846ae7bb8 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:28:34 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] VM Started (Lifecycle Event)
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:28:34 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280914.40797, c64aff93-15fa-4520-b6ac-cdcacb49478e => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:28:34 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] VM Resumed (Lifecycle Event)
Apr 12 06:28:34 user nova-compute[71711]: INFO nova.compute.manager [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Took 6.06 seconds to spawn the instance on the hypervisor.
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:28:34 user nova-compute[71711]: INFO nova.compute.manager [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Took 6.92 seconds to spawn the instance on the hypervisor.
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:28:34 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280914.4101002, c64aff93-15fa-4520-b6ac-cdcacb49478e => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:28:34 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] VM Started (Lifecycle Event)
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:28:34 user nova-compute[71711]: INFO nova.compute.manager [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Took 7.59 seconds to build instance.
Apr 12 06:28:34 user nova-compute[71711]: INFO nova.compute.manager [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Took 6.96 seconds to build instance.
Apr 12 06:28:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2045adbf-db70-4767-93d9-452959131b31 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "5364688b-cc08-4407-94f5-974846ae7bb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.683s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4e540144-64b7-43cc-846d-ec1952ecd2db tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.063s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-changed-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Refreshing instance network info cache due to event network-changed-f2b23249-b032-47f5-973e-922f210b40b2. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] Acquiring lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] Acquired lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG nova.network.neutron [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Refreshing network info cache for port f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:35 user nova-compute[71711]: INFO nova.compute.manager [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Terminating instance
Apr 12 06:28:35 user nova-compute[71711]: DEBUG nova.compute.manager [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG nova.network.neutron [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updated VIF entry in instance network info cache for port f2b23249-b032-47f5-973e-922f210b40b2. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG nova.network.neutron [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updating instance_info_cache with network_info: [{"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-69d0a474-1fde-4426-b593-47fc58c4a9b8 req-125cc317-eb7e-4a88-9bf7-0f6b351334dd service nova] Releasing lock "refresh_cache-7141c80d-34a9-40cc-a792-b01ffd9155b6" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:28:36 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Instance destroyed successfully.
Apr 12 06:28:36 user nova-compute[71711]: DEBUG nova.objects.instance [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lazy-loading 'resources' on Instance uuid 7141c80d-34a9-40cc-a792-b01ffd9155b6 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:23:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1182120878',display_name='tempest-TestShelveInstance-server-1182120878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1182120878',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/XYJS5WZMk53chHKmw/+iSEEOXZF7wP3pIbC0AGTht+XIXJedtGoPTQqkFu+XBL60BEsYozXDU+97steer9vl1moNpsewzRRDuc/MQvBwxKIIaehE8Onlx0BWl81dCFA==',key_name='tempest-TestShelveInstance-1634672150',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:26:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7742afa38eb46818efaf3b811c417ba',ramdisk_id='',reservation_id='r-jkmurz28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-735091148',owner_user_name='tempest-TestShelveInstance-735091148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:26:57Z,user_data=None,user_id='9ed3a446901644b6a622afb3166f08dc',uuid=7141c80d-34a9-40cc-a792-b01ffd9155b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Converting VIF {"id": "f2b23249-b032-47f5-973e-922f210b40b2", "address": "fa:16:3e:29:02:01", "network": {"id": "e87d03d7-dafc-4dc8-bcd0-2c975242ad12", "bridge": "br-int", "label": "tempest-TestShelveInstance-1184414231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7742afa38eb46818efaf3b811c417ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b23249-b0", "ovs_interfaceid": "f2b23249-b032-47f5-973e-922f210b40b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_vif [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2b23249-b0, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:36 user nova-compute[71711]: INFO os_vif [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:02:01,bridge_name='br-int',has_traffic_filtering=True,id=f2b23249-b032-47f5-973e-922f210b40b2,network=Network(e87d03d7-dafc-4dc8-bcd0-2c975242ad12),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2b23249-b0')
Apr 12 06:28:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcOxDrPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:28:36 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1bd8e5-3e1e-4e34-b0ec-a851bc21d129]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:28:36 user nova-compute[71711]: No targets found.
Apr 12 06:28:36 user nova-compute[71711]: iSNS:
Apr 12 06:28:36 user nova-compute[71711]: No targets found.
Apr 12 06:28:36 user nova-compute[71711]: STATIC:
Apr 12 06:28:36 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a
Apr 12 06:28:36 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:28:36 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:28:36 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975
Apr 12 06:28:36 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:28:36 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:28:36 user nova-compute[71711]: FIRMWARE:
Apr 12 06:28:36 user nova-compute[71711]: No targets found.
Apr 12 06:28:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:28:36 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:28:36 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bcaa34-6fa0-4e5e-8a8d-c536273499a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c90257c-b2bb-4cd9-8c09-369d3f242aa0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:28:36 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:28:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:28:36 user nova-compute[71711]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a (non-flash)
Apr 12 06:28:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c2501f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a'): ({'sdg'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Removing single pathed devices sdg {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e00a1-9316-4b1d-aee4-dcceae820e93]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[52466326-8a85-4b39-9346-6ccece80f670]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Flushing IO for device /dev/sdg {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[626b015d-7b7e-483e-be61-c8a31eeee53a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f8f292-470b-442d-acf0-b68c0d799247]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] SCSI volumes sdg have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4dc027a2-d498b40f84436c16', '/dev/disk/by-id/scsi-26434393862343066', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4dc027a2') {{(pid=81777) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[065d62f9-2bd4-48a1-8b00-3c07c1f6df72]: (4, None) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16c73d3-10bc-4a38-bfef-49adb75b2ebf]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb52146-d972-4b4d-8a49-addb93d5cb6e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260]
Apr 12 06:28:36 user nova-compute[71711]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a, portal: 172.16.0.220,3260] successful.
Apr 12 06:28:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb4b861-8fb3-41e6-bb47-94b297da9311]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] <== disconnect_volume: return (321ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:28:36 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Deleting instance files /opt/stack/data/nova/instances/7141c80d-34a9-40cc-a792-b01ffd9155b6_del
Apr 12 06:28:36 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Deletion of /opt/stack/data/nova/instances/7141c80d-34a9-40cc-a792-b01ffd9155b6_del complete
Apr 12 06:28:36 user nova-compute[71711]: INFO nova.compute.manager [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 12 06:28:36 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:28:36 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:28:37 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:28:37 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Took 0.47 seconds to deallocate network for instance.
Apr 12 06:28:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-74390907-c45d-4521-afe8-ad0bd2ccbb2f req-d0499f2a-dbe8-46df-a6c6-c8bdfb35ae8e service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-vif-deleted-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:37 user nova-compute[71711]: INFO nova.compute.manager [req-74390907-c45d-4521-afe8-ad0bd2ccbb2f req-d0499f2a-dbe8-46df-a6c6-c8bdfb35ae8e service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Neutron deleted interface f2b23249-b032-47f5-973e-922f210b40b2; detaching it from the instance and deleting it from the info cache
Apr 12 06:28:37 user nova-compute[71711]: DEBUG nova.network.neutron [req-74390907-c45d-4521-afe8-ad0bd2ccbb2f req-d0499f2a-dbe8-46df-a6c6-c8bdfb35ae8e service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:28:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-74390907-c45d-4521-afe8-ad0bd2ccbb2f req-d0499f2a-dbe8-46df-a6c6-c8bdfb35ae8e service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Detach interface failed, port_id=f2b23249-b032-47f5-973e-922f210b40b2, reason: Instance 7141c80d-34a9-40cc-a792-b01ffd9155b6 could not be found. {{(pid=71711) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 06:28:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-vif-unplugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] No waiting events found dispatching network-vif-unplugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:28:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-vif-unplugged-f2b23249-b032-47f5-973e-922f210b40b2 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:28:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received event network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] Acquiring lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] No waiting events found dispatching network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:28:37 user nova-compute[71711]: WARNING nova.compute.manager [req-9bab47dd-02af-46ca-b97e-a97862830f60 req-68760c61-36db-4c1d-8bff-32c857e2cdb0 service nova] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Received unexpected event network-vif-plugged-f2b23249-b032-47f5-973e-922f210b40b2 for instance with vm_state active and task_state deleting.
Apr 12 06:28:38 user nova-compute[71711]: INFO nova.compute.manager [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Took 0.90 seconds to detach 1 volumes for instance.
Apr 12 06:28:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Deleting volume: d3ef3a9b-2394-48ed-a2a6-e85ab6076c8a {{(pid=71711) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 06:28:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:38 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:28:38 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:28:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:38 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Deleted allocations for instance 7141c80d-34a9-40cc-a792-b01ffd9155b6
Apr 12 06:28:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cda63090-1ed5-42d0-9deb-bf59bec5a385 tempest-TestShelveInstance-735091148 tempest-TestShelveInstance-735091148-project-member] Lock "7141c80d-34a9-40cc-a792-b01ffd9155b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.198s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:40 user nova-compute[71711]: INFO nova.compute.manager [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Detaching volume d96a84d2-2151-4f60-a72b-25e84b80c975
Apr 12 06:28:40 user nova-compute[71711]: INFO nova.virt.block_device [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Attempting to driver detach volume d96a84d2-2151-4f60-a72b-25e84b80c975 from mountpoint /dev/vdb
Apr 12 06:28:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Attempting to detach device vdb from instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:28:40 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:28:40 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:28:40 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:28:40 user nova-compute[71711]:   <serial>d96a84d2-2151-4f60-a72b-25e84b80c975</serial>
Apr 12 06:28:40 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 06:28:40 user nova-compute[71711]: </disk>
Apr 12 06:28:40 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:28:40 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully detached device vdb from instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 from the persistent domain config.
Apr 12 06:28:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:28:40 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:28:40 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:28:40 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:28:40 user nova-compute[71711]:   <serial>d96a84d2-2151-4f60-a72b-25e84b80c975</serial>
Apr 12 06:28:40 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 06:28:40 user nova-compute[71711]: </disk>
Apr 12 06:28:40 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681280920.8545291, 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:28:40 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully detached device vdb from instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 from the live domain config.
Apr 12 06:28:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoTzegHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:28:40 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:28:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bb9ad2-8b32-4951-8206-79670d8ded73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:28:40 user nova-compute[71711]: No targets found.
Apr 12 06:28:40 user nova-compute[71711]: iSNS:
Apr 12 06:28:40 user nova-compute[71711]: No targets found.
Apr 12 06:28:40 user nova-compute[71711]: STATIC:
Apr 12 06:28:40 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975
Apr 12 06:28:40 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:28:40 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:28:40 user nova-compute[71711]: FIRMWARE:
Apr 12 06:28:40 user nova-compute[71711]: No targets found.
Apr 12 06:28:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:28:40 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:28:40 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24c1342-85d0-4a88-a066-7f093c465890]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71eba3c-a377-4a15-989c-bf965c140ba1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:28:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 (non-flash)
Apr 12 06:28:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9961e12320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975'): ({'sdf'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Removing single pathed devices sdf {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[48309f77-8cb6-47b4-83e4-a20b09d1c118]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe623cbd-f130-47a3-94fd-5c4665816b40]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flushing IO for device /dev/sdf {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:28:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e056767-d9ab-47cf-9fe5-9a2516ef3f93]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3493e127-6ebe-4cb3-bf9c-df3125022905]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f277b1-a8fc-47d4-bac7-32b15ad42497]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c734e36-24ce-4067-ad2a-a744ccfc8936]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260]
Apr 12 06:28:41 user nova-compute[71711]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975, portal: 172.16.0.220,3260] successful.
Apr 12 06:28:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96a84d2-2151-4f60-a72b-25e84b80c975 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9034a01a-0da3-436a-85ae-d125aa75500a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== disconnect_volume: return (300ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Received event network-changed-491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Refreshing instance network info cache due to event network-changed-491bd5ef-7e10-49f3-ae6e-3804489ade6f. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] Acquiring lock "refresh_cache-adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] Acquired lock "refresh_cache-adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG nova.network.neutron [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Refreshing network info cache for port 491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:41 user nova-compute[71711]: INFO nova.compute.manager [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Terminating instance
Apr 12 06:28:41 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'flavor' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c9e119b0-7bda-433e-88bb-cda15dd8fe8b tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.722s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-7f11e4f8-00a5-4939-9797-9b886049d59b req-63849c80-1543-4b1e-afe1-5396c463b913 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Received event network-vif-unplugged-491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7f11e4f8-00a5-4939-9797-9b886049d59b req-63849c80-1543-4b1e-afe1-5396c463b913 service nova] Acquiring lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7f11e4f8-00a5-4939-9797-9b886049d59b req-63849c80-1543-4b1e-afe1-5396c463b913 service nova] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7f11e4f8-00a5-4939-9797-9b886049d59b req-63849c80-1543-4b1e-afe1-5396c463b913 service nova] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-7f11e4f8-00a5-4939-9797-9b886049d59b req-63849c80-1543-4b1e-afe1-5396c463b913 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] No waiting events found dispatching network-vif-unplugged-491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-7f11e4f8-00a5-4939-9797-9b886049d59b req-63849c80-1543-4b1e-afe1-5396c463b913 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Received event network-vif-unplugged-491bd5ef-7e10-49f3-ae6e-3804489ade6f for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG nova.network.neutron [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Updated VIF entry in instance network info cache for port 491bd5ef-7e10-49f3-ae6e-3804489ade6f. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG nova.network.neutron [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Updating instance_info_cache with network_info: [{"id": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "address": "fa:16:3e:c0:49:12", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491bd5ef-7e", "ovs_interfaceid": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-deed7674-52ad-4224-a0da-b222cedd8c2f req-fd74afe7-dd37-4183-b61c-7f50e16f3be8 service nova] Releasing lock "refresh_cache-adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:42 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Instance destroyed successfully.
Apr 12 06:28:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'resources' on Instance uuid adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:25:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-87019523',display_name='tempest-TestStampPattern-server-87019523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-87019523',id=13,image_ref='1a9eeca1-ea38-407f-a16c-de352efc9154',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4bTwZ/jGMekzeEcO14GzYK3DGdo+oNI7mA/YkJRKaAKcLzVE0FyC6M9scMJglXnoXkUOrevnkhp2qnhWOlMGwLE9qftr8ybB+0jBRxkTjyexl7VDlmRC5pzxifapKyKw==',key_name='tempest-TestStampPattern-1405244377',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:25:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a7d74130d4d417a93de352381229948',ramdisk_id='',reservation_id='r-m117mluh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a528e600-7358-4b92-9b71-12759f405b38',image_min_disk='1',image_min_ram='0',image_owner_id='5a7d74130d4d417a93de352381229948',image_owner_project_name='tempest-TestStampPattern-1782553765',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1782553765-project-member',image_user_id='d59314e79d0344a2943391c3c2ab628a',owner_project_name='tempest-TestStampPattern-1782553765',owner_user_name='tempest-TestStampPattern-1782553765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:25:59Z,user_data=None,user_id='d59314e79d0344a2943391c3c2ab628a',uuid=adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "address": "fa:16:3e:c0:49:12", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491bd5ef-7e", "ovs_interfaceid": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Converting VIF {"id": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "address": "fa:16:3e:c0:49:12", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491bd5ef-7e", "ovs_interfaceid": "491bd5ef-7e10-49f3-ae6e-3804489ade6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:49:12,bridge_name='br-int',has_traffic_filtering=True,id=491bd5ef-7e10-49f3-ae6e-3804489ade6f,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491bd5ef-7e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG os_vif [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:49:12,bridge_name='br-int',has_traffic_filtering=True,id=491bd5ef-7e10-49f3-ae6e-3804489ade6f,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491bd5ef-7e') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap491bd5ef-7e, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:42 user nova-compute[71711]: INFO os_vif [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:49:12,bridge_name='br-int',has_traffic_filtering=True,id=491bd5ef-7e10-49f3-ae6e-3804489ade6f,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491bd5ef-7e')
Apr 12 06:28:42 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Deleting instance files /opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf_del
Apr 12 06:28:42 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Deletion of /opt/stack/data/nova/instances/adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf_del complete
Apr 12 06:28:42 user nova-compute[71711]: INFO nova.compute.manager [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 12 06:28:42 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:28:42 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:28:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:28:43 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:28:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:28:43 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:28:43 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Took 0.45 seconds to deallocate network for instance.
Apr 12 06:28:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-c4400e1f-6292-4a22-af29-21a544272020 req-f083ee9d-2d69-4059-a0aa-2428428c174b service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Received event network-vif-deleted-491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:43 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:28:43 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:28:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:43 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Deleted allocations for instance adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf
Apr 12 06:28:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7db08954-bfc6-49f9-b50a-56caa4ca94c4 tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:44 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:28:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-e88e3eda-cd16-4079-a913-4970f89071ee req-e662f41e-ca2f-4627-82ab-f2085eaa41a8 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Received event network-vif-plugged-491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e88e3eda-cd16-4079-a913-4970f89071ee req-e662f41e-ca2f-4627-82ab-f2085eaa41a8 service nova] Acquiring lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e88e3eda-cd16-4079-a913-4970f89071ee req-e662f41e-ca2f-4627-82ab-f2085eaa41a8 service nova] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e88e3eda-cd16-4079-a913-4970f89071ee req-e662f41e-ca2f-4627-82ab-f2085eaa41a8 service nova] Lock "adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-e88e3eda-cd16-4079-a913-4970f89071ee req-e662f41e-ca2f-4627-82ab-f2085eaa41a8 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] No waiting events found dispatching network-vif-plugged-491bd5ef-7e10-49f3-ae6e-3804489ade6f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:28:44 user nova-compute[71711]: WARNING nova.compute.manager [req-e88e3eda-cd16-4079-a913-4970f89071ee req-e662f41e-ca2f-4627-82ab-f2085eaa41a8 service nova] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Received unexpected event network-vif-plugged-491bd5ef-7e10-49f3-ae6e-3804489ade6f for instance with vm_state deleted and task_state None.
Apr 12 06:28:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:28:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:28:45 user nova-compute[71711]: DEBUG nova.compute.manager [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Received event network-changed-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:28:45 user nova-compute[71711]: DEBUG nova.compute.manager [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Refreshing instance network info cache due to event network-changed-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:28:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] Acquiring lock "refresh_cache-d78558e6-437e-44dd-b6b4-123ed3447094" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:28:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] Acquired lock "refresh_cache-d78558e6-437e-44dd-b6b4-123ed3447094" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:28:45 user nova-compute[71711]: DEBUG nova.network.neutron [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Refreshing network info cache for port b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG nova.network.neutron [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Updated VIF entry in instance network info cache for port b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG nova.network.neutron [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Updating instance_info_cache with network_info: [{"id": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "address": "fa:16:3e:c2:55:e5", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fc0ea9-eb", "ovs_interfaceid": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-70faf560-915f-4249-a59d-a578a8d1af33 req-1c281ce7-9b3d-4108-bd2b-af4bde319fd5 service nova] Releasing lock "refresh_cache-d78558e6-437e-44dd-b6b4-123ed3447094" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating instance_info_cache with network_info: [{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:28:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "d78558e6-437e-44dd-b6b4-123ed3447094" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "d78558e6-437e-44dd-b6b4-123ed3447094" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG nova.objects.instance [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lazy-loading 'flavor' on Instance uuid d78558e6-437e-44dd-b6b4-123ed3447094 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "d78558e6-437e-44dd-b6b4-123ed3447094" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "d78558e6-437e-44dd-b6b4-123ed3447094" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "d78558e6-437e-44dd-b6b4-123ed3447094" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:47 user nova-compute[71711]: INFO nova.compute.manager [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Attaching volume fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 to /dev/vdb
Apr 12 06:28:47 user nova-compute[71711]: DEBUG os_brick.utils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0676a8d9-dc4d-45e8-b6d7-1fb579f3795e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afbc4ad-99b0-4fdd-944b-a0ff7175c434]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb561e8-ea67-4776-acc5-31f1c17c34c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[722834fd-dd88-421b-a1a0-f2106c32260b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:28:47 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f248e313-012b-4d44-838b-bbc5410ba868]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG os_brick.utils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Updating existing volume attachment record: efaa0182-6b6b-4dc3-9332-fa3a85d62c99 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:49 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:28:49 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:28:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7942MB free_disk=26.286720275878906GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:28:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7dee97a4-9497-43c2-a688-7bedd1441885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance a528e600-7358-4b92-9b71-12759f405b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance d78558e6-437e-44dd-b6b4-123ed3447094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:28:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280916.3490803, 7141c80d-34a9-40cc-a792-b01ffd9155b6 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:28:51 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] VM Stopped (Lifecycle Event)
Apr 12 06:28:51 user nova-compute[71711]: DEBUG nova.compute.manager [None req-f6cf9882-b3d4-4d79-91a4-8204e0659cdc None None] [instance: 7141c80d-34a9-40cc-a792-b01ffd9155b6] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkWfKHao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:28:51 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:28:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:28:51 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:28:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:28:51 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:28:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e6e3c7-0d68-4c91-bb9e-427fe8c00e20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:28:51 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[374bc3db-1e95-4957-9953-7e68a7c42cb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5] added
Apr 12 06:28:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[caacc8ac-4d67-44ed-9a75-f06dd4f6041f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e925058-2259-4d76-b8c1-8f023d041810]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkWfKHao {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkWfKHao" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c0d3b5-d129-42d4-93c6-a4e14da77731]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qkWfKHao'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f55687e-b210-46c0-b765-21b54e1f8641]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[853dd08c-f983-40e3-b00e-869b26722284]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:28:52 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:28:52 user nova-compute[71711]:  {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:28:52 user nova-compute[71711]: WARNING os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 06:28:52 user nova-compute[71711]: 
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[44464b5e-c38d-4f3a-acf6-4d6be681b200]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5, portal: 172.16.0.220,3260]
Apr 12 06:28:52 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5, portal: 172.16.0.220,3260] successful.
Apr 12 06:28:52 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7d56a1-7306-4a12-a8ad-a6332c28e565]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[917f3545-746e-41c3-935d-b8673a671adc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 (non-flash)
Apr 12 06:28:52 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 (non-flash)
Apr 12 06:28:52 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3f92a3-6f20-4249-bd82-a05867f38fe6]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:28:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:53 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:28:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkWfKHao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:28:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:28:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26632323033383335', 'path': '/dev/sdb'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:28:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632323033383335', 'path': '/dev/sdb'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:28:53 user nova-compute[71711]: DEBUG nova.objects.instance [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lazy-loading 'flavor' on Instance uuid d78558e6-437e-44dd-b6b4-123ed3447094 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:28:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:28:53 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:28:53 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:28:53 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:28:53 user nova-compute[71711]:   <serial>fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5</serial>
Apr 12 06:28:53 user nova-compute[71711]: </disk>
Apr 12 06:28:53 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:28:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:28:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:28:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] No VIF found with MAC fa:16:3e:c2:55:e5, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:28:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fc10ba32-a626-465b-9b5a-5414f61e058e tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "d78558e6-437e-44dd-b6b4-123ed3447094" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.423s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "d78558e6-437e-44dd-b6b4-123ed3447094" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:28:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "d78558e6-437e-44dd-b6b4-123ed3447094" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:28:55 user nova-compute[71711]: INFO nova.compute.manager [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Detaching volume fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5
Apr 12 06:28:55 user nova-compute[71711]: INFO nova.virt.block_device [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Attempting to driver detach volume fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 from mountpoint /dev/vdb
Apr 12 06:28:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Attempting to detach device vdb from instance d78558e6-437e-44dd-b6b4-123ed3447094 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:28:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:28:55 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:28:55 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:28:55 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:28:55 user nova-compute[71711]:   <serial>fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5</serial>
Apr 12 06:28:55 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:28:55 user nova-compute[71711]: </disk>
Apr 12 06:28:55 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:28:55 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Successfully detached device vdb from instance d78558e6-437e-44dd-b6b4-123ed3447094 from the persistent domain config.
Apr 12 06:28:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d78558e6-437e-44dd-b6b4-123ed3447094 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:28:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:28:55 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:28:55 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:28:55 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:28:55 user nova-compute[71711]:   <serial>fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5</serial>
Apr 12 06:28:55 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:28:55 user nova-compute[71711]: </disk>
Apr 12 06:28:55 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681280936.0350778, d78558e6-437e-44dd-b6b4-123ed3447094 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d78558e6-437e-44dd-b6b4-123ed3447094 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:28:56 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Successfully detached device vdb from instance d78558e6-437e-44dd-b6b4-123ed3447094 from the live domain config.
Apr 12 06:28:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkWfKHao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:28:56 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d3c384-a013-4279-9699-a929bb94ddef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:28:56 user nova-compute[71711]: No targets found.
Apr 12 06:28:56 user nova-compute[71711]: iSNS:
Apr 12 06:28:56 user nova-compute[71711]: No targets found.
Apr 12 06:28:56 user nova-compute[71711]: STATIC:
Apr 12 06:28:56 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5
Apr 12 06:28:56 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:28:56 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:28:56 user nova-compute[71711]: FIRMWARE:
Apr 12 06:28:56 user nova-compute[71711]: No targets found.
Apr 12 06:28:56 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:28:56 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:28:56 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e2bf14-88c3-442e-a517-cc30c0afa67b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c19746e-5ed2-4c52-bb38-bd75eae36c5a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 (non-flash)
Apr 12 06:28:56 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 (non-flash)
Apr 12 06:28:56 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c250940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5'): ({'sdb'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Removing single pathed devices sdb {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b2e3f0-5f00-4386-99ce-fad2595a6d15]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3f8f75-cb26-42e1-a453-57d6cdcc8958]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Flushing IO for device /dev/sdb {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[391aa881-91f5-4281-8d36-33e728536f85]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb40273-230b-4324-960f-23868dd34b20]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d9ce02-e550-43af-b587-7017852fc994]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[232140a9-08dc-4df4-b899-28ef133ab82d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5, portal: 172.16.0.220,3260]
Apr 12 06:28:56 user nova-compute[71711]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5, portal: 172.16.0.220,3260] successful.
Apr 12 06:28:56 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd011c7e-ce16-44ff-bd8c-fc0c9b78e1c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c247db-8051-42da-97f0-5eec674fc872]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] <== disconnect_volume: return (309ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:28:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:28:57 user nova-compute[71711]: DEBUG nova.objects.instance [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lazy-loading 'flavor' on Instance uuid d78558e6-437e-44dd-b6b4-123ed3447094 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:28:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d53aa7e0-d752-4163-9e1a-ae67792c8a2b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "d78558e6-437e-44dd-b6b4-123ed3447094" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.681s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:28:57 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280922.6045253, adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:28:57 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] VM Stopped (Lifecycle Event)
Apr 12 06:28:57 user nova-compute[71711]: DEBUG nova.compute.manager [None req-36dbcc0c-68d7-46d0-971d-fe677aae77e0 None None] [instance: adc9dfaa-2bb5-4d62-89b2-860a1cfc0edf] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:28:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:28:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "35495bca-759b-4940-af0e-e6da34c73b34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "35495bca-759b-4940-af0e-e6da34c73b34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:29:11 user nova-compute[71711]: INFO nova.compute.claims [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Claim successful on node user
Apr 12 06:29:11 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:29:11 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:29:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG nova.policy [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67fbba4b2bbc4bb3b2255ef1facd7442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a755743544f7c97644faad13bdeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:29:11 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Creating image(s)
Apr 12 06:29:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "/opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "/opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "/opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk 1073741824" returned: 0 in 0.054s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Successfully created port: c690dd1f-30e2-4a1b-983a-5089b2f351bd {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Cannot resize image /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG nova.objects.instance [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lazy-loading 'migration_context' on Instance uuid 35495bca-759b-4940-af0e-e6da34c73b34 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Ensure instance console log exists: /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Successfully updated port: c690dd1f-30e2-4a1b-983a-5089b2f351bd {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "refresh_cache-35495bca-759b-4940-af0e-e6da34c73b34" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquired lock "refresh_cache-35495bca-759b-4940-af0e-e6da34c73b34" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Received event network-changed-c690dd1f-30e2-4a1b-983a-5089b2f351bd {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Refreshing instance network info cache due to event network-changed-c690dd1f-30e2-4a1b-983a-5089b2f351bd. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] Acquiring lock "refresh_cache-35495bca-759b-4940-af0e-e6da34c73b34" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Updating instance_info_cache with network_info: [{"id": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "address": "fa:16:3e:92:7f:cc", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc690dd1f-30", "ovs_interfaceid": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Releasing lock "refresh_cache-35495bca-759b-4940-af0e-e6da34c73b34" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Instance network_info: |[{"id": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "address": "fa:16:3e:92:7f:cc", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc690dd1f-30", "ovs_interfaceid": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] Acquired lock "refresh_cache-35495bca-759b-4940-af0e-e6da34c73b34" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.network.neutron [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Refreshing network info cache for port c690dd1f-30e2-4a1b-983a-5089b2f351bd {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Start _get_guest_xml network_info=[{"id": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "address": "fa:16:3e:92:7f:cc", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc690dd1f-30", "ovs_interfaceid": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:29:13 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:29:13 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1598595924',display_name='tempest-VolumesActionsTest-instance-1598595924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1598595924',id=19,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0a755743544f7c97644faad13bdeb4',ramdisk_id='',reservation_id='r-0dc00umq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1914558791',owner_user_name='tempest-VolumesActionsTest-1914558791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:29:12Z,user_data=None,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',uuid=35495bca-759b-4940-af0e-e6da34c73b34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "address": "fa:16:3e:92:7f:cc", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc690dd1f-30", "ovs_interfaceid": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Converting VIF {"id": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "address": "fa:16:3e:92:7f:cc", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc690dd1f-30", "ovs_interfaceid": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:7f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c690dd1f-30e2-4a1b-983a-5089b2f351bd,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc690dd1f-30') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.objects.instance [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lazy-loading 'pci_devices' on Instance uuid 35495bca-759b-4940-af0e-e6da34c73b34 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:29:13 user nova-compute[71711]:   <uuid>35495bca-759b-4940-af0e-e6da34c73b34</uuid>
Apr 12 06:29:13 user nova-compute[71711]:   <name>instance-00000013</name>
Apr 12 06:29:13 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:29:13 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:29:13 user nova-compute[71711]:   <metadata>
Apr 12 06:29:13 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:29:13 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:29:13 user nova-compute[71711]:       <nova:name>tempest-VolumesActionsTest-instance-1598595924</nova:name>
Apr 12 06:29:13 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:29:13</nova:creationTime>
Apr 12 06:29:13 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:29:13 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:29:13 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:29:13 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:29:13 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:29:13 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:29:13 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:29:13 user nova-compute[71711]:       <nova:owner>
Apr 12 06:29:13 user nova-compute[71711]:         <nova:user uuid="67fbba4b2bbc4bb3b2255ef1facd7442">tempest-VolumesActionsTest-1914558791-project-member</nova:user>
Apr 12 06:29:13 user nova-compute[71711]:         <nova:project uuid="4d0a755743544f7c97644faad13bdeb4">tempest-VolumesActionsTest-1914558791</nova:project>
Apr 12 06:29:13 user nova-compute[71711]:       </nova:owner>
Apr 12 06:29:13 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:29:13 user nova-compute[71711]:       <nova:ports>
Apr 12 06:29:13 user nova-compute[71711]:         <nova:port uuid="c690dd1f-30e2-4a1b-983a-5089b2f351bd">
Apr 12 06:29:13 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 06:29:13 user nova-compute[71711]:         </nova:port>
Apr 12 06:29:13 user nova-compute[71711]:       </nova:ports>
Apr 12 06:29:13 user nova-compute[71711]:     </nova:instance>
Apr 12 06:29:13 user nova-compute[71711]:   </metadata>
Apr 12 06:29:13 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:29:13 user nova-compute[71711]:     <system>
Apr 12 06:29:13 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:29:13 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:29:13 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:29:13 user nova-compute[71711]:       <entry name="serial">35495bca-759b-4940-af0e-e6da34c73b34</entry>
Apr 12 06:29:13 user nova-compute[71711]:       <entry name="uuid">35495bca-759b-4940-af0e-e6da34c73b34</entry>
Apr 12 06:29:13 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:29:13 user nova-compute[71711]:     </system>
Apr 12 06:29:13 user nova-compute[71711]:   </sysinfo>
Apr 12 06:29:13 user nova-compute[71711]:   <os>
Apr 12 06:29:13 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:29:13 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:29:13 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:29:13 user nova-compute[71711]:   </os>
Apr 12 06:29:13 user nova-compute[71711]:   <features>
Apr 12 06:29:13 user nova-compute[71711]:     <acpi/>
Apr 12 06:29:13 user nova-compute[71711]:     <apic/>
Apr 12 06:29:13 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:29:13 user nova-compute[71711]:   </features>
Apr 12 06:29:13 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:29:13 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:29:13 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:29:13 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:29:13 user nova-compute[71711]:   </clock>
Apr 12 06:29:13 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:29:13 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:29:13 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:29:13 user nova-compute[71711]:   </cpu>
Apr 12 06:29:13 user nova-compute[71711]:   <devices>
Apr 12 06:29:13 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:29:13 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:29:13 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk"/>
Apr 12 06:29:13 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:29:13 user nova-compute[71711]:     </disk>
Apr 12 06:29:13 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:29:13 user nova-compute[71711]:       <mac address="fa:16:3e:92:7f:cc"/>
Apr 12 06:29:13 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:29:13 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:29:13 user nova-compute[71711]:       <target dev="tapc690dd1f-30"/>
Apr 12 06:29:13 user nova-compute[71711]:     </interface>
Apr 12 06:29:13 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:29:13 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/console.log" append="off"/>
Apr 12 06:29:13 user nova-compute[71711]:     </serial>
Apr 12 06:29:13 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:29:13 user nova-compute[71711]:     <video>
Apr 12 06:29:13 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:29:13 user nova-compute[71711]:     </video>
Apr 12 06:29:13 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:29:13 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:29:13 user nova-compute[71711]:     </rng>
Apr 12 06:29:13 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:29:13 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:29:13 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:29:13 user nova-compute[71711]:     </memballoon>
Apr 12 06:29:13 user nova-compute[71711]:   </devices>
Apr 12 06:29:13 user nova-compute[71711]: </domain>
Apr 12 06:29:13 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1598595924',display_name='tempest-VolumesActionsTest-instance-1598595924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1598595924',id=19,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0a755743544f7c97644faad13bdeb4',ramdisk_id='',reservation_id='r-0dc00umq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1914558791',owner_user_name='tempest-VolumesActionsTest-1914558791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:29:12Z,user_data=None,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',uuid=35495bca-759b-4940-af0e-e6da34c73b34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "address": "fa:16:3e:92:7f:cc", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc690dd1f-30", "ovs_interfaceid": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Converting VIF {"id": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "address": "fa:16:3e:92:7f:cc", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc690dd1f-30", "ovs_interfaceid": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:7f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c690dd1f-30e2-4a1b-983a-5089b2f351bd,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc690dd1f-30') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG os_vif [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:7f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c690dd1f-30e2-4a1b-983a-5089b2f351bd,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc690dd1f-30') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc690dd1f-30, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc690dd1f-30, col_values=(('external_ids', {'iface-id': 'c690dd1f-30e2-4a1b-983a-5089b2f351bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:7f:cc', 'vm-uuid': '35495bca-759b-4940-af0e-e6da34c73b34'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:13 user nova-compute[71711]: INFO os_vif [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:7f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c690dd1f-30e2-4a1b-983a-5089b2f351bd,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc690dd1f-30')
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] No VIF found with MAC fa:16:3e:92:7f:cc, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.network.neutron [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Updated VIF entry in instance network info cache for port c690dd1f-30e2-4a1b-983a-5089b2f351bd. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG nova.network.neutron [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Updating instance_info_cache with network_info: [{"id": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "address": "fa:16:3e:92:7f:cc", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc690dd1f-30", "ovs_interfaceid": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:29:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d4f965d3-f7ab-49d0-9a6d-d36dcdda2924 req-59876ed3-556d-4a98-923f-66dd59df8c2b service nova] Releasing lock "refresh_cache-35495bca-759b-4940-af0e-e6da34c73b34" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:29:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-a67a145c-a498-474d-8a52-02e93d4dfbad req-02747e57-fe9f-44f5-8429-6e3a59e309b3 service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Received event network-vif-plugged-c690dd1f-30e2-4a1b-983a-5089b2f351bd {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a67a145c-a498-474d-8a52-02e93d4dfbad req-02747e57-fe9f-44f5-8429-6e3a59e309b3 service nova] Acquiring lock "35495bca-759b-4940-af0e-e6da34c73b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a67a145c-a498-474d-8a52-02e93d4dfbad req-02747e57-fe9f-44f5-8429-6e3a59e309b3 service nova] Lock "35495bca-759b-4940-af0e-e6da34c73b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a67a145c-a498-474d-8a52-02e93d4dfbad req-02747e57-fe9f-44f5-8429-6e3a59e309b3 service nova] Lock "35495bca-759b-4940-af0e-e6da34c73b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-a67a145c-a498-474d-8a52-02e93d4dfbad req-02747e57-fe9f-44f5-8429-6e3a59e309b3 service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] No waiting events found dispatching network-vif-plugged-c690dd1f-30e2-4a1b-983a-5089b2f351bd {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:29:15 user nova-compute[71711]: WARNING nova.compute.manager [req-a67a145c-a498-474d-8a52-02e93d4dfbad req-02747e57-fe9f-44f5-8429-6e3a59e309b3 service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Received unexpected event network-vif-plugged-c690dd1f-30e2-4a1b-983a-5089b2f351bd for instance with vm_state building and task_state spawning.
Apr 12 06:29:16 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280956.9849088, 35495bca-759b-4940-af0e-e6da34c73b34 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:29:16 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] VM Resumed (Lifecycle Event)
Apr 12 06:29:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:29:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:29:16 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Instance spawned successfully.
Apr 12 06:29:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:17 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280956.9866056, 35495bca-759b-4940-af0e-e6da34c73b34 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:29:17 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] VM Started (Lifecycle Event)
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:29:17 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:29:17 user nova-compute[71711]: INFO nova.compute.manager [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Took 5.31 seconds to spawn the instance on the hypervisor.
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-3a3cfa9f-0f51-4a96-bc04-17f4dbfa9103 req-e688e737-8a88-4bd3-93f3-b820dd967c6d service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Received event network-vif-plugged-c690dd1f-30e2-4a1b-983a-5089b2f351bd {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3a3cfa9f-0f51-4a96-bc04-17f4dbfa9103 req-e688e737-8a88-4bd3-93f3-b820dd967c6d service nova] Acquiring lock "35495bca-759b-4940-af0e-e6da34c73b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3a3cfa9f-0f51-4a96-bc04-17f4dbfa9103 req-e688e737-8a88-4bd3-93f3-b820dd967c6d service nova] Lock "35495bca-759b-4940-af0e-e6da34c73b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3a3cfa9f-0f51-4a96-bc04-17f4dbfa9103 req-e688e737-8a88-4bd3-93f3-b820dd967c6d service nova] Lock "35495bca-759b-4940-af0e-e6da34c73b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-3a3cfa9f-0f51-4a96-bc04-17f4dbfa9103 req-e688e737-8a88-4bd3-93f3-b820dd967c6d service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] No waiting events found dispatching network-vif-plugged-c690dd1f-30e2-4a1b-983a-5089b2f351bd {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:29:17 user nova-compute[71711]: WARNING nova.compute.manager [req-3a3cfa9f-0f51-4a96-bc04-17f4dbfa9103 req-e688e737-8a88-4bd3-93f3-b820dd967c6d service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Received unexpected event network-vif-plugged-c690dd1f-30e2-4a1b-983a-5089b2f351bd for instance with vm_state building and task_state spawning.
Apr 12 06:29:17 user nova-compute[71711]: INFO nova.compute.manager [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Took 6.03 seconds to build instance.
Apr 12 06:29:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2a345360-1091-4f82-b6a8-be89637f381d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "35495bca-759b-4940-af0e-e6da34c73b34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.133s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:29:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:29:21 user nova-compute[71711]: INFO nova.compute.claims [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Claim successful on node user
Apr 12 06:29:21 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:29:21 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:29:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:29:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:29:21 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:29:21 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:29:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:29:21 user nova-compute[71711]: INFO nova.virt.block_device [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Booting with blank volume at /dev/vda
Apr 12 06:29:21 user nova-compute[71711]: DEBUG nova.policy [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:29:22 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Successfully created port: 0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Successfully updated port: 0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquired lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-changed-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Refreshing instance network info cache due to event network-changed-0beef467-c01f-4521-8d4a-85c0f1f7dd1f. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] Acquiring lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Updating instance_info_cache with network_info: [{"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Releasing lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Instance network_info: |[{"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] Acquired lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG nova.network.neutron [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Refreshing network info cache for port 0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:29:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:24 user nova-compute[71711]: DEBUG nova.network.neutron [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Updated VIF entry in instance network info cache for port 0beef467-c01f-4521-8d4a-85c0f1f7dd1f. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:29:24 user nova-compute[71711]: DEBUG nova.network.neutron [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Updating instance_info_cache with network_info: [{"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:29:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d2028457-3a27-4bf7-88c0-bafd1b7a0f12 req-46988aed-64d3-4c03-a8ca-28349eca78b6 service nova] Releasing lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:29:24 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'flavor' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:29:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquired lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:29:24 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:29:24 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'info_cache' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updating instance_info_cache with network_info: [{"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Releasing lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:29:25 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Instance destroyed successfully.
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'resources' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-347561886',display_name='tempest-AttachVolumeTestJSON-server-347561886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-347561886',id=2,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwrNegtuUQxlGPyN3pFJ5X6ve+WFpWa8ZN5z88plFcMC7jAP25D92PakJ6yQbAkk2nQ1OF8Me+pJecej1aLutIgKjYku+yi3zY9Z7mDtSHYPVUZwc5/VPOAX8HIWorUMg==',key_name='tempest-keypair-673948167',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:21:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4f124d62c4d345d9af22f1557abca276',ramdisk_id='',reservation_id='r-l92zv936',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1680327736',owner_user_name='tempest-AttachVolumeTestJSON-1680327736-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d58cc232d0094bebacf147c6b61a0989',uuid=7dee97a4-9497-43c2-a688-7bedd1441885,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converting VIF {"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG os_vif [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e69d862-c0, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:29:25 user nova-compute[71711]: INFO os_vif [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0')
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Start _get_guest_xml network_info=[{"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'numa_topology' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:25 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:29:25 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-347561886',display_name='tempest-AttachVolumeTestJSON-server-347561886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-347561886',id=2,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwrNegtuUQxlGPyN3pFJ5X6ve+WFpWa8ZN5z88plFcMC7jAP25D92PakJ6yQbAkk2nQ1OF8Me+pJecej1aLutIgKjYku+yi3zY9Z7mDtSHYPVUZwc5/VPOAX8HIWorUMg==',key_name='tempest-keypair-673948167',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:21:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4f124d62c4d345d9af22f1557abca276',ramdisk_id='',reservation_id='r-l92zv936',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1680327736',owner_user_name='tempest-AttachVolumeTestJSON-1680327736-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d58cc232d0094bebacf147c6b61a0989',uuid=7dee97a4-9497-43c2-a688-7bedd1441885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converting VIF {"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'pci_devices' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:29:25 user nova-compute[71711]:   <uuid>7dee97a4-9497-43c2-a688-7bedd1441885</uuid>
Apr 12 06:29:25 user nova-compute[71711]:   <name>instance-00000002</name>
Apr 12 06:29:25 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:29:25 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:29:25 user nova-compute[71711]:   <metadata>
Apr 12 06:29:25 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:29:25 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:29:25 user nova-compute[71711]:       <nova:name>tempest-AttachVolumeTestJSON-server-347561886</nova:name>
Apr 12 06:29:25 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:29:25</nova:creationTime>
Apr 12 06:29:25 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:29:25 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:29:25 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:29:25 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:29:25 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:29:25 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:29:25 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:29:25 user nova-compute[71711]:       <nova:owner>
Apr 12 06:29:25 user nova-compute[71711]:         <nova:user uuid="d58cc232d0094bebacf147c6b61a0989">tempest-AttachVolumeTestJSON-1680327736-project-member</nova:user>
Apr 12 06:29:25 user nova-compute[71711]:         <nova:project uuid="4f124d62c4d345d9af22f1557abca276">tempest-AttachVolumeTestJSON-1680327736</nova:project>
Apr 12 06:29:25 user nova-compute[71711]:       </nova:owner>
Apr 12 06:29:25 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:29:25 user nova-compute[71711]:       <nova:ports>
Apr 12 06:29:25 user nova-compute[71711]:         <nova:port uuid="1e69d862-c01c-48c7-8795-00233f9e7812">
Apr 12 06:29:25 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 06:29:25 user nova-compute[71711]:         </nova:port>
Apr 12 06:29:25 user nova-compute[71711]:       </nova:ports>
Apr 12 06:29:25 user nova-compute[71711]:     </nova:instance>
Apr 12 06:29:25 user nova-compute[71711]:   </metadata>
Apr 12 06:29:25 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:29:25 user nova-compute[71711]:     <system>
Apr 12 06:29:25 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:29:25 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:29:25 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:29:25 user nova-compute[71711]:       <entry name="serial">7dee97a4-9497-43c2-a688-7bedd1441885</entry>
Apr 12 06:29:25 user nova-compute[71711]:       <entry name="uuid">7dee97a4-9497-43c2-a688-7bedd1441885</entry>
Apr 12 06:29:25 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:29:25 user nova-compute[71711]:     </system>
Apr 12 06:29:25 user nova-compute[71711]:   </sysinfo>
Apr 12 06:29:25 user nova-compute[71711]:   <os>
Apr 12 06:29:25 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:29:25 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:29:25 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:29:25 user nova-compute[71711]:   </os>
Apr 12 06:29:25 user nova-compute[71711]:   <features>
Apr 12 06:29:25 user nova-compute[71711]:     <acpi/>
Apr 12 06:29:25 user nova-compute[71711]:     <apic/>
Apr 12 06:29:25 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:29:25 user nova-compute[71711]:   </features>
Apr 12 06:29:25 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:29:25 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:29:25 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:29:25 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:29:25 user nova-compute[71711]:   </clock>
Apr 12 06:29:25 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:29:25 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:29:25 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:29:25 user nova-compute[71711]:   </cpu>
Apr 12 06:29:25 user nova-compute[71711]:   <devices>
Apr 12 06:29:25 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:29:25 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:29:25 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk"/>
Apr 12 06:29:25 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:29:25 user nova-compute[71711]:     </disk>
Apr 12 06:29:25 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:29:25 user nova-compute[71711]:       <mac address="fa:16:3e:4c:89:31"/>
Apr 12 06:29:25 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:29:25 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:29:25 user nova-compute[71711]:       <target dev="tap1e69d862-c0"/>
Apr 12 06:29:25 user nova-compute[71711]:     </interface>
Apr 12 06:29:25 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:29:25 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/console.log" append="off"/>
Apr 12 06:29:25 user nova-compute[71711]:     </serial>
Apr 12 06:29:25 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:29:25 user nova-compute[71711]:     <video>
Apr 12 06:29:25 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:29:25 user nova-compute[71711]:     </video>
Apr 12 06:29:25 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:29:25 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:29:25 user nova-compute[71711]:     </rng>
Apr 12 06:29:25 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:29:25 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:29:25 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:29:25 user nova-compute[71711]:     </memballoon>
Apr 12 06:29:25 user nova-compute[71711]:   </devices>
Apr 12 06:29:25 user nova-compute[71711]: </domain>
Apr 12 06:29:25 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Cannot resize image /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'migration_context' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-347561886',display_name='tempest-AttachVolumeTestJSON-server-347561886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-347561886',id=2,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwrNegtuUQxlGPyN3pFJ5X6ve+WFpWa8ZN5z88plFcMC7jAP25D92PakJ6yQbAkk2nQ1OF8Me+pJecej1aLutIgKjYku+yi3zY9Z7mDtSHYPVUZwc5/VPOAX8HIWorUMg==',key_name='tempest-keypair-673948167',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:21:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4f124d62c4d345d9af22f1557abca276',ramdisk_id='',reservation_id='r-l92zv936',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1680327736',owner_user_name='tempest-AttachVolumeTestJSON-1680327736-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d58cc232d0094bebacf147c6b61a0989',uuid=7dee97a4-9497-43c2-a688-7bedd1441885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converting VIF {"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG os_vif [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e69d862-c0, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e69d862-c0, col_values=(('external_ids', {'iface-id': '1e69d862-c01c-48c7-8795-00233f9e7812', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:89:31', 'vm-uuid': '7dee97a4-9497-43c2-a688-7bedd1441885'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:29:26 user nova-compute[71711]: INFO os_vif [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0')
Apr 12 06:29:27 user nova-compute[71711]: DEBUG os_brick.utils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[68302e8a-ee85-46fe-9c36-55498aae57dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f55ab7-9d87-4dcf-aced-35fb6f35761a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0138cef6-96d5-4db2-8029-9dc7332a74bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff5bff5-da02-4682-8c32-187da81e03d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:29:27 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9707aba-c309-407e-b541-d83220cf115a]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG os_brick.utils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Updating existing volume attachment record: 86dae585-faec-4479-90d5-f67160f21e09 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-2c7a77fd-a7a1-4391-a20b-590d308e0f05 req-f8dfa994-6114-49a2-b1cf-6fe514ce929c service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2c7a77fd-a7a1-4391-a20b-590d308e0f05 req-f8dfa994-6114-49a2-b1cf-6fe514ce929c service nova] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2c7a77fd-a7a1-4391-a20b-590d308e0f05 req-f8dfa994-6114-49a2-b1cf-6fe514ce929c service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2c7a77fd-a7a1-4391-a20b-590d308e0f05 req-f8dfa994-6114-49a2-b1cf-6fe514ce929c service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-2c7a77fd-a7a1-4391-a20b-590d308e0f05 req-f8dfa994-6114-49a2-b1cf-6fe514ce929c service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] No waiting events found dispatching network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:29:27 user nova-compute[71711]: WARNING nova.compute.manager [req-2c7a77fd-a7a1-4391-a20b-590d308e0f05 req-f8dfa994-6114-49a2-b1cf-6fe514ce929c service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received unexpected event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 for instance with vm_state stopped and task_state powering-on.
Apr 12 06:29:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:29 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280969.7870047, 7dee97a4-9497-43c2-a688-7bedd1441885 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:29:29 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] VM Resumed (Lifecycle Event)
Apr 12 06:29:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:29:29 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Instance rebooted successfully.
Apr 12 06:29:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1f50b6e6-0501-4772-8f08-26fdfcdd9769 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:29:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:29:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:29:29 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 06:29:29 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280969.788755, 7dee97a4-9497-43c2-a688-7bedd1441885 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:29:29 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] VM Started (Lifecycle Event)
Apr 12 06:29:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-d6f13ccb-5e1e-4c5a-a9e1-9576252ebc2a req-2962badb-9dc9-4c71-a526-9d246500fc4b service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d6f13ccb-5e1e-4c5a-a9e1-9576252ebc2a req-2962badb-9dc9-4c71-a526-9d246500fc4b service nova] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d6f13ccb-5e1e-4c5a-a9e1-9576252ebc2a req-2962badb-9dc9-4c71-a526-9d246500fc4b service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d6f13ccb-5e1e-4c5a-a9e1-9576252ebc2a req-2962badb-9dc9-4c71-a526-9d246500fc4b service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-d6f13ccb-5e1e-4c5a-a9e1-9576252ebc2a req-2962badb-9dc9-4c71-a526-9d246500fc4b service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] No waiting events found dispatching network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:29:29 user nova-compute[71711]: WARNING nova.compute.manager [req-d6f13ccb-5e1e-4c5a-a9e1-9576252ebc2a req-2962badb-9dc9-4c71-a526-9d246500fc4b service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received unexpected event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 for instance with vm_state stopped and task_state powering-on.
Apr 12 06:29:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:29:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:29:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:29:32 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Creating image(s)
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Ensure instance console log exists: /opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Start _get_guest_xml network_info=[{"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQizkfug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ebb36f74-c4a3-4108-949d-1fb8918f9a8c', 'attached_at': '', 'detached_at': '', 'volume_id': '9013e447-dbe0-46fc-97fe-c8d65768b297', 'serial': '9013e447-dbe0-46fc-97fe-c8d65768b297'}, 'attachment_id': '86dae585-faec-4479-90d5-f67160f21e09', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:29:32 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:29:32 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQizkfug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:29:32 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:29:32 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:29:32 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[55903d7a-5677-429c-9841-a2fa502e96b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:29:32 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dd930f-e6bb-4b56-9ad3-dfc8310fcdbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297] added
Apr 12 06:29:32 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[13adafe1-64fe-401f-9f78-41f9c96a6b09]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[20109918-d35b-4341-84c6-a454243bfc21]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KQizkfug {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KQizkfug" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ac2e98-9df5-4a54-b285-277178354326]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KQizkfug'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e34c8c7-f2cb-4c7b-ad8e-90655ec05594]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e99c02-7376-4f8d-b04e-a0cb568168b8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:29:32 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:29:32 user nova-compute[71711]:  {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:29:32 user nova-compute[71711]: WARNING os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 06:29:32 user nova-compute[71711]: 
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcc27ec-bae9-494a-a6dc-7565f8961742]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297, portal: 172.16.0.220,3260]
Apr 12 06:29:32 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297, portal: 172.16.0.220,3260] successful.
Apr 12 06:29:32 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4d7df3-1c17-4b80-82a3-af172c47b696]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e204fe3-8fd1-4124-8687-18d7a436b8af]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:29:32 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:29:32 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3115839-8013-4e2e-8964-b40140f3cf0d]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:29:32 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQizkfug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23838393638393066', 'path': '/dev/sdb'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838393638393066', 'path': '/dev/sdb'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:29:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2071604680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2071604680',id=20,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-8q0yisgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:29:22Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=ebb36f74-c4a3-4108-949d-1fb8918f9a8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=0beef467-c01f-4521-8d4a-85c0f1f7dd1f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beef467-c0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'pci_devices' on Instance uuid ebb36f74-c4a3-4108-949d-1fb8918f9a8c {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:29:33 user nova-compute[71711]:   <uuid>ebb36f74-c4a3-4108-949d-1fb8918f9a8c</uuid>
Apr 12 06:29:33 user nova-compute[71711]:   <name>instance-00000014</name>
Apr 12 06:29:33 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:29:33 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:29:33 user nova-compute[71711]:   <metadata>
Apr 12 06:29:33 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:29:33 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:29:33 user nova-compute[71711]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2071604680</nova:name>
Apr 12 06:29:33 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:29:32</nova:creationTime>
Apr 12 06:29:33 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:29:33 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:29:33 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:29:33 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:29:33 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:29:33 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:29:33 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:29:33 user nova-compute[71711]:       <nova:owner>
Apr 12 06:29:33 user nova-compute[71711]:         <nova:user uuid="2e5e4455358643b8830ce8c96aad5aad">tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member</nova:user>
Apr 12 06:29:33 user nova-compute[71711]:         <nova:project uuid="0ecae91e53ee4d70a8dc24c7febc2a0e">tempest-ServerBootFromVolumeStableRescueTest-2063268056</nova:project>
Apr 12 06:29:33 user nova-compute[71711]:       </nova:owner>
Apr 12 06:29:33 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:29:33 user nova-compute[71711]:       <nova:ports>
Apr 12 06:29:33 user nova-compute[71711]:         <nova:port uuid="0beef467-c01f-4521-8d4a-85c0f1f7dd1f">
Apr 12 06:29:33 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 06:29:33 user nova-compute[71711]:         </nova:port>
Apr 12 06:29:33 user nova-compute[71711]:       </nova:ports>
Apr 12 06:29:33 user nova-compute[71711]:     </nova:instance>
Apr 12 06:29:33 user nova-compute[71711]:   </metadata>
Apr 12 06:29:33 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:29:33 user nova-compute[71711]:     <system>
Apr 12 06:29:33 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:29:33 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:29:33 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:29:33 user nova-compute[71711]:       <entry name="serial">ebb36f74-c4a3-4108-949d-1fb8918f9a8c</entry>
Apr 12 06:29:33 user nova-compute[71711]:       <entry name="uuid">ebb36f74-c4a3-4108-949d-1fb8918f9a8c</entry>
Apr 12 06:29:33 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:29:33 user nova-compute[71711]:     </system>
Apr 12 06:29:33 user nova-compute[71711]:   </sysinfo>
Apr 12 06:29:33 user nova-compute[71711]:   <os>
Apr 12 06:29:33 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:29:33 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:29:33 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:29:33 user nova-compute[71711]:   </os>
Apr 12 06:29:33 user nova-compute[71711]:   <features>
Apr 12 06:29:33 user nova-compute[71711]:     <acpi/>
Apr 12 06:29:33 user nova-compute[71711]:     <apic/>
Apr 12 06:29:33 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:29:33 user nova-compute[71711]:   </features>
Apr 12 06:29:33 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:29:33 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:29:33 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:29:33 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:29:33 user nova-compute[71711]:   </clock>
Apr 12 06:29:33 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:29:33 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:29:33 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:29:33 user nova-compute[71711]:   </cpu>
Apr 12 06:29:33 user nova-compute[71711]:   <devices>
Apr 12 06:29:33 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:29:33 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:29:33 user nova-compute[71711]:       <source dev="/dev/sdb"/>
Apr 12 06:29:33 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:29:33 user nova-compute[71711]:       <serial>9013e447-dbe0-46fc-97fe-c8d65768b297</serial>
Apr 12 06:29:33 user nova-compute[71711]:     </disk>
Apr 12 06:29:33 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:29:33 user nova-compute[71711]:       <mac address="fa:16:3e:33:83:aa"/>
Apr 12 06:29:33 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:29:33 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:29:33 user nova-compute[71711]:       <target dev="tap0beef467-c0"/>
Apr 12 06:29:33 user nova-compute[71711]:     </interface>
Apr 12 06:29:33 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:29:33 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/console.log" append="off"/>
Apr 12 06:29:33 user nova-compute[71711]:     </serial>
Apr 12 06:29:33 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:29:33 user nova-compute[71711]:     <video>
Apr 12 06:29:33 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:29:33 user nova-compute[71711]:     </video>
Apr 12 06:29:33 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:29:33 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:29:33 user nova-compute[71711]:     </rng>
Apr 12 06:29:33 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:29:33 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:29:33 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:29:33 user nova-compute[71711]:     </memballoon>
Apr 12 06:29:33 user nova-compute[71711]:   </devices>
Apr 12 06:29:33 user nova-compute[71711]: </domain>
Apr 12 06:29:33 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:29:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2071604680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2071604680',id=20,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-8q0yisgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:29:22Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=ebb36f74-c4a3-4108-949d-1fb8918f9a8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=0beef467-c01f-4521-8d4a-85c0f1f7dd1f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beef467-c0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG os_vif [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=0beef467-c01f-4521-8d4a-85c0f1f7dd1f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beef467-c0') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0beef467-c0, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0beef467-c0, col_values=(('external_ids', {'iface-id': '0beef467-c01f-4521-8d4a-85c0f1f7dd1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:83:aa', 'vm-uuid': 'ebb36f74-c4a3-4108-949d-1fb8918f9a8c'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:33 user nova-compute[71711]: INFO os_vif [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=0beef467-c01f-4521-8d4a-85c0f1f7dd1f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beef467-c0')
Apr 12 06:29:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No VIF found with MAC fa:16:3e:33:83:aa, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:29:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-91628120-db25-4ab4-9a26-851e33cf9153 req-7bf8fdd5-7765-4ee3-95a1-f02cc09a1857 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-91628120-db25-4ab4-9a26-851e33cf9153 req-7bf8fdd5-7765-4ee3-95a1-f02cc09a1857 service nova] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-91628120-db25-4ab4-9a26-851e33cf9153 req-7bf8fdd5-7765-4ee3-95a1-f02cc09a1857 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-91628120-db25-4ab4-9a26-851e33cf9153 req-7bf8fdd5-7765-4ee3-95a1-f02cc09a1857 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-91628120-db25-4ab4-9a26-851e33cf9153 req-7bf8fdd5-7765-4ee3-95a1-f02cc09a1857 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] No waiting events found dispatching network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:29:35 user nova-compute[71711]: WARNING nova.compute.manager [req-91628120-db25-4ab4-9a26-851e33cf9153 req-7bf8fdd5-7765-4ee3-95a1-f02cc09a1857 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received unexpected event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance with vm_state building and task_state spawning.
Apr 12 06:29:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280977.1173844, ebb36f74-c4a3-4108-949d-1fb8918f9a8c => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:29:37 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] VM Resumed (Lifecycle Event)
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:29:37 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Instance spawned successfully.
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-2bb8b9dd-ae5f-49b1-b7ec-cbf8ae4ff2e5 req-7a96c5b2-8fc4-40a8-971c-d0e8b758ad6a service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2bb8b9dd-ae5f-49b1-b7ec-cbf8ae4ff2e5 req-7a96c5b2-8fc4-40a8-971c-d0e8b758ad6a service nova] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2bb8b9dd-ae5f-49b1-b7ec-cbf8ae4ff2e5 req-7a96c5b2-8fc4-40a8-971c-d0e8b758ad6a service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2bb8b9dd-ae5f-49b1-b7ec-cbf8ae4ff2e5 req-7a96c5b2-8fc4-40a8-971c-d0e8b758ad6a service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-2bb8b9dd-ae5f-49b1-b7ec-cbf8ae4ff2e5 req-7a96c5b2-8fc4-40a8-971c-d0e8b758ad6a service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] No waiting events found dispatching network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:29:37 user nova-compute[71711]: WARNING nova.compute.manager [req-2bb8b9dd-ae5f-49b1-b7ec-cbf8ae4ff2e5 req-7a96c5b2-8fc4-40a8-971c-d0e8b758ad6a service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received unexpected event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance with vm_state building and task_state spawning.
Apr 12 06:29:37 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280977.122021, ebb36f74-c4a3-4108-949d-1fb8918f9a8c => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:29:37 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] VM Started (Lifecycle Event)
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:29:37 user nova-compute[71711]: INFO nova.compute.manager [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Took 5.16 seconds to spawn the instance on the hypervisor.
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:29:37 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:29:37 user nova-compute[71711]: INFO nova.compute.manager [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Took 16.04 seconds to build instance.
Apr 12 06:29:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d675fdf-ce24-41e7-8f7e-73e83a11390d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.142s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "a528e600-7358-4b92-9b71-12759f405b38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "a528e600-7358-4b92-9b71-12759f405b38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "a528e600-7358-4b92-9b71-12759f405b38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "a528e600-7358-4b92-9b71-12759f405b38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "a528e600-7358-4b92-9b71-12759f405b38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:37 user nova-compute[71711]: INFO nova.compute.manager [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Terminating instance
Apr 12 06:29:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-17b1eaec-8932-43ee-9bf3-156327f408fa req-e6b1ba75-a1a9-4925-894d-f853e72840e6 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Received event network-vif-unplugged-039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-17b1eaec-8932-43ee-9bf3-156327f408fa req-e6b1ba75-a1a9-4925-894d-f853e72840e6 service nova] Acquiring lock "a528e600-7358-4b92-9b71-12759f405b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-17b1eaec-8932-43ee-9bf3-156327f408fa req-e6b1ba75-a1a9-4925-894d-f853e72840e6 service nova] Lock "a528e600-7358-4b92-9b71-12759f405b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-17b1eaec-8932-43ee-9bf3-156327f408fa req-e6b1ba75-a1a9-4925-894d-f853e72840e6 service nova] Lock "a528e600-7358-4b92-9b71-12759f405b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-17b1eaec-8932-43ee-9bf3-156327f408fa req-e6b1ba75-a1a9-4925-894d-f853e72840e6 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] No waiting events found dispatching network-vif-unplugged-039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-17b1eaec-8932-43ee-9bf3-156327f408fa req-e6b1ba75-a1a9-4925-894d-f853e72840e6 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Received event network-vif-unplugged-039ecba8-673d-41c4-a5bd-f5671896c181 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:38 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: a528e600-7358-4b92-9b71-12759f405b38] Instance destroyed successfully.
Apr 12 06:29:38 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lazy-loading 'resources' on Instance uuid a528e600-7358-4b92-9b71-12759f405b38 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:22:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-903505246',display_name='tempest-TestStampPattern-server-903505246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-903505246',id=8,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4bTwZ/jGMekzeEcO14GzYK3DGdo+oNI7mA/YkJRKaAKcLzVE0FyC6M9scMJglXnoXkUOrevnkhp2qnhWOlMGwLE9qftr8ybB+0jBRxkTjyexl7VDlmRC5pzxifapKyKw==',key_name='tempest-TestStampPattern-1405244377',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:22:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a7d74130d4d417a93de352381229948',ramdisk_id='',reservation_id='r-94iwt0ct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1782553765',owner_user_name='tempest-TestStampPattern-1782553765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:25:46Z,user_data=None,user_id='d59314e79d0344a2943391c3c2ab628a',uuid=a528e600-7358-4b92-9b71-12759f405b38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "039ecba8-673d-41c4-a5bd-f5671896c181", "address": "fa:16:3e:d6:d7:ba", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039ecba8-67", "ovs_interfaceid": "039ecba8-673d-41c4-a5bd-f5671896c181", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Converting VIF {"id": "039ecba8-673d-41c4-a5bd-f5671896c181", "address": "fa:16:3e:d6:d7:ba", "network": {"id": "85180900-1c38-4677-a676-89d6643196d0", "bridge": "br-int", "label": "tempest-TestStampPattern-1661064212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7d74130d4d417a93de352381229948", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap039ecba8-67", "ovs_interfaceid": "039ecba8-673d-41c4-a5bd-f5671896c181", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d7:ba,bridge_name='br-int',has_traffic_filtering=True,id=039ecba8-673d-41c4-a5bd-f5671896c181,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039ecba8-67') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG os_vif [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d7:ba,bridge_name='br-int',has_traffic_filtering=True,id=039ecba8-673d-41c4-a5bd-f5671896c181,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039ecba8-67') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap039ecba8-67, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:38 user nova-compute[71711]: INFO os_vif [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:d7:ba,bridge_name='br-int',has_traffic_filtering=True,id=039ecba8-673d-41c4-a5bd-f5671896c181,network=Network(85180900-1c38-4677-a676-89d6643196d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap039ecba8-67')
Apr 12 06:29:38 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Deleting instance files /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38_del
Apr 12 06:29:38 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Deletion of /opt/stack/data/nova/instances/a528e600-7358-4b92-9b71-12759f405b38_del complete
Apr 12 06:29:38 user nova-compute[71711]: INFO nova.compute.manager [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] [instance: a528e600-7358-4b92-9b71-12759f405b38] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 06:29:38 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: a528e600-7358-4b92-9b71-12759f405b38] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: a528e600-7358-4b92-9b71-12759f405b38] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:29:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Received event network-changed-039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Refreshing instance network info cache due to event network-changed-039ecba8-673d-41c4-a5bd-f5671896c181. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] Acquiring lock "refresh_cache-a528e600-7358-4b92-9b71-12759f405b38" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] Acquired lock "refresh_cache-a528e600-7358-4b92-9b71-12759f405b38" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG nova.network.neutron [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Refreshing network info cache for port 039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:29:39 user nova-compute[71711]: INFO nova.network.neutron [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Port 039ecba8-673d-41c4-a5bd-f5671896c181 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 12 06:29:39 user nova-compute[71711]: DEBUG nova.network.neutron [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8904c603-7c98-41a1-9e83-5a55810fc97c req-c9a1681f-be29-468b-9b82-e42ef72bd2d5 service nova] Releasing lock "refresh_cache-a528e600-7358-4b92-9b71-12759f405b38" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: a528e600-7358-4b92-9b71-12759f405b38] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:29:39 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: a528e600-7358-4b92-9b71-12759f405b38] Took 0.64 seconds to deallocate network for instance.
Apr 12 06:29:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-61459aed-7d76-497f-b3bd-3bb659b437f7 req-67241939-c34e-4456-9b32-68f2e3252329 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Received event network-vif-deleted-039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:29:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:39 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Deleted allocations for instance a528e600-7358-4b92-9b71-12759f405b38
Apr 12 06:29:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ddb06ec6-6813-4f6c-8bc0-b2029d559e8c tempest-TestStampPattern-1782553765 tempest-TestStampPattern-1782553765-project-member] Lock "a528e600-7358-4b92-9b71-12759f405b38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-b38f0b3d-486b-481e-84f7-d60a3c526f26 req-7e4680f7-3f00-4aaa-9c8a-128b9f6ca315 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Received event network-vif-plugged-039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b38f0b3d-486b-481e-84f7-d60a3c526f26 req-7e4680f7-3f00-4aaa-9c8a-128b9f6ca315 service nova] Acquiring lock "a528e600-7358-4b92-9b71-12759f405b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b38f0b3d-486b-481e-84f7-d60a3c526f26 req-7e4680f7-3f00-4aaa-9c8a-128b9f6ca315 service nova] Lock "a528e600-7358-4b92-9b71-12759f405b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b38f0b3d-486b-481e-84f7-d60a3c526f26 req-7e4680f7-3f00-4aaa-9c8a-128b9f6ca315 service nova] Lock "a528e600-7358-4b92-9b71-12759f405b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-b38f0b3d-486b-481e-84f7-d60a3c526f26 req-7e4680f7-3f00-4aaa-9c8a-128b9f6ca315 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] No waiting events found dispatching network-vif-plugged-039ecba8-673d-41c4-a5bd-f5671896c181 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:29:40 user nova-compute[71711]: WARNING nova.compute.manager [req-b38f0b3d-486b-481e-84f7-d60a3c526f26 req-7e4680f7-3f00-4aaa-9c8a-128b9f6ca315 service nova] [instance: a528e600-7358-4b92-9b71-12759f405b38] Received unexpected event network-vif-plugged-039ecba8-673d-41c4-a5bd-f5671896c181 for instance with vm_state deleted and task_state None.
Apr 12 06:29:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "11dc4450-74e9-48ab-9de3-024baa6af9f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:29:46 user nova-compute[71711]: INFO nova.compute.claims [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Claim successful on node user
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG nova.compute.manager [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG nova.compute.manager [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG nova.network.neutron [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:29:47 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:29:47 user nova-compute[71711]: DEBUG nova.compute.manager [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG nova.policy [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd682efe6338b4989beb714cce25e8e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b656fa0bf05484889563c50ccc9a7e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG nova.compute.manager [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:29:47 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Creating image(s)
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "/opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "/opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "/opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk 1073741824" returned: 0 in 0.050s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.147s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG nova.network.neutron [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Successfully created port: 3abeb81f-8a9b-40c6-a526-7a10818160b0 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Cannot resize image /opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG nova.objects.instance [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lazy-loading 'migration_context' on Instance uuid 11dc4450-74e9-48ab-9de3-024baa6af9f1 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Ensure instance console log exists: /opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:29:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.network.neutron [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Successfully updated port: 3abeb81f-8a9b-40c6-a526-7a10818160b0 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Received event network-changed-3abeb81f-8a9b-40c6-a526-7a10818160b0 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Refreshing instance network info cache due to event network-changed-3abeb81f-8a9b-40c6-a526-7a10818160b0. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] Acquiring lock "refresh_cache-11dc4450-74e9-48ab-9de3-024baa6af9f1" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] Acquired lock "refresh_cache-11dc4450-74e9-48ab-9de3-024baa6af9f1" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.network.neutron [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Refreshing network info cache for port 3abeb81f-8a9b-40c6-a526-7a10818160b0 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:29:49 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:29:49 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7763MB free_disk=26.342830657958984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "refresh_cache-11dc4450-74e9-48ab-9de3-024baa6af9f1" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.network.neutron [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 46b32f3f-86c4-450a-a710-7d0c05ea4097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7dee97a4-9497-43c2-a688-7bedd1441885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance d78558e6-437e-44dd-b6b4-123ed3447094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 35495bca-759b-4940-af0e-e6da34c73b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.network.neutron [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f09147d1-059a-4f99-971c-7afa8c91eece req-7b856871-f1a7-48a7-a872-5eb3423a5ce2 service nova] Releasing lock "refresh_cache-11dc4450-74e9-48ab-9de3-024baa6af9f1" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquired lock "refresh_cache-11dc4450-74e9-48ab-9de3-024baa6af9f1" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.network.neutron [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.network.neutron [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:29:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.network.neutron [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Updating instance_info_cache with network_info: [{"id": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "address": "fa:16:3e:15:f9:0a", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3abeb81f-8a", "ovs_interfaceid": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Releasing lock "refresh_cache-11dc4450-74e9-48ab-9de3-024baa6af9f1" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.compute.manager [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Instance network_info: |[{"id": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "address": "fa:16:3e:15:f9:0a", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3abeb81f-8a", "ovs_interfaceid": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Start _get_guest_xml network_info=[{"id": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "address": "fa:16:3e:15:f9:0a", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3abeb81f-8a", "ovs_interfaceid": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:29:50 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:29:50 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-872207444',display_name='tempest-VolumesAdminNegativeTest-server-872207444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-872207444',id=21,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b656fa0bf05484889563c50ccc9a7e9',ramdisk_id='',reservation_id='r-fwf9oncs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1313851069',owner_user_name='tempest-VolumesAdminNegativeTest-1313851069-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:29:48Z,user_data=None,user_id='d682efe6338b4989beb714cce25e8e31',uuid=11dc4450-74e9-48ab-9de3-024baa6af9f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "address": "fa:16:3e:15:f9:0a", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3abeb81f-8a", "ovs_interfaceid": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Converting VIF {"id": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "address": "fa:16:3e:15:f9:0a", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3abeb81f-8a", "ovs_interfaceid": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=3abeb81f-8a9b-40c6-a526-7a10818160b0,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3abeb81f-8a') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.objects.instance [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lazy-loading 'pci_devices' on Instance uuid 11dc4450-74e9-48ab-9de3-024baa6af9f1 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:29:50 user nova-compute[71711]:   <uuid>11dc4450-74e9-48ab-9de3-024baa6af9f1</uuid>
Apr 12 06:29:50 user nova-compute[71711]:   <name>instance-00000015</name>
Apr 12 06:29:50 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:29:50 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:29:50 user nova-compute[71711]:   <metadata>
Apr 12 06:29:50 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:29:50 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:29:50 user nova-compute[71711]:       <nova:name>tempest-VolumesAdminNegativeTest-server-872207444</nova:name>
Apr 12 06:29:50 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:29:50</nova:creationTime>
Apr 12 06:29:50 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:29:50 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:29:50 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:29:50 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:29:50 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:29:50 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:29:50 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:29:50 user nova-compute[71711]:       <nova:owner>
Apr 12 06:29:50 user nova-compute[71711]:         <nova:user uuid="d682efe6338b4989beb714cce25e8e31">tempest-VolumesAdminNegativeTest-1313851069-project-member</nova:user>
Apr 12 06:29:50 user nova-compute[71711]:         <nova:project uuid="0b656fa0bf05484889563c50ccc9a7e9">tempest-VolumesAdminNegativeTest-1313851069</nova:project>
Apr 12 06:29:50 user nova-compute[71711]:       </nova:owner>
Apr 12 06:29:50 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:29:50 user nova-compute[71711]:       <nova:ports>
Apr 12 06:29:50 user nova-compute[71711]:         <nova:port uuid="3abeb81f-8a9b-40c6-a526-7a10818160b0">
Apr 12 06:29:50 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 06:29:50 user nova-compute[71711]:         </nova:port>
Apr 12 06:29:50 user nova-compute[71711]:       </nova:ports>
Apr 12 06:29:50 user nova-compute[71711]:     </nova:instance>
Apr 12 06:29:50 user nova-compute[71711]:   </metadata>
Apr 12 06:29:50 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:29:50 user nova-compute[71711]:     <system>
Apr 12 06:29:50 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:29:50 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:29:50 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:29:50 user nova-compute[71711]:       <entry name="serial">11dc4450-74e9-48ab-9de3-024baa6af9f1</entry>
Apr 12 06:29:50 user nova-compute[71711]:       <entry name="uuid">11dc4450-74e9-48ab-9de3-024baa6af9f1</entry>
Apr 12 06:29:50 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:29:50 user nova-compute[71711]:     </system>
Apr 12 06:29:50 user nova-compute[71711]:   </sysinfo>
Apr 12 06:29:50 user nova-compute[71711]:   <os>
Apr 12 06:29:50 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:29:50 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:29:50 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:29:50 user nova-compute[71711]:   </os>
Apr 12 06:29:50 user nova-compute[71711]:   <features>
Apr 12 06:29:50 user nova-compute[71711]:     <acpi/>
Apr 12 06:29:50 user nova-compute[71711]:     <apic/>
Apr 12 06:29:50 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:29:50 user nova-compute[71711]:   </features>
Apr 12 06:29:50 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:29:50 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:29:50 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:29:50 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:29:50 user nova-compute[71711]:   </clock>
Apr 12 06:29:50 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:29:50 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:29:50 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:29:50 user nova-compute[71711]:   </cpu>
Apr 12 06:29:50 user nova-compute[71711]:   <devices>
Apr 12 06:29:50 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:29:50 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:29:50 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk"/>
Apr 12 06:29:50 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:29:50 user nova-compute[71711]:     </disk>
Apr 12 06:29:50 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:29:50 user nova-compute[71711]:       <mac address="fa:16:3e:15:f9:0a"/>
Apr 12 06:29:50 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:29:50 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:29:50 user nova-compute[71711]:       <target dev="tap3abeb81f-8a"/>
Apr 12 06:29:50 user nova-compute[71711]:     </interface>
Apr 12 06:29:50 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:29:50 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/console.log" append="off"/>
Apr 12 06:29:50 user nova-compute[71711]:     </serial>
Apr 12 06:29:50 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:29:50 user nova-compute[71711]:     <video>
Apr 12 06:29:50 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:29:50 user nova-compute[71711]:     </video>
Apr 12 06:29:50 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:29:50 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:29:50 user nova-compute[71711]:     </rng>
Apr 12 06:29:50 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:29:50 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:29:50 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:29:50 user nova-compute[71711]:     </memballoon>
Apr 12 06:29:50 user nova-compute[71711]:   </devices>
Apr 12 06:29:50 user nova-compute[71711]: </domain>
Apr 12 06:29:50 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-872207444',display_name='tempest-VolumesAdminNegativeTest-server-872207444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-872207444',id=21,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b656fa0bf05484889563c50ccc9a7e9',ramdisk_id='',reservation_id='r-fwf9oncs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1313851069',owner_user_name='tempest-VolumesAdminNegativeTest-1313851069-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:29:48Z,user_data=None,user_id='d682efe6338b4989beb714cce25e8e31',uuid=11dc4450-74e9-48ab-9de3-024baa6af9f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "address": "fa:16:3e:15:f9:0a", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3abeb81f-8a", "ovs_interfaceid": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Converting VIF {"id": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "address": "fa:16:3e:15:f9:0a", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3abeb81f-8a", "ovs_interfaceid": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=3abeb81f-8a9b-40c6-a526-7a10818160b0,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3abeb81f-8a') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG os_vif [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=3abeb81f-8a9b-40c6-a526-7a10818160b0,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3abeb81f-8a') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3abeb81f-8a, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3abeb81f-8a, col_values=(('external_ids', {'iface-id': '3abeb81f-8a9b-40c6-a526-7a10818160b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:f9:0a', 'vm-uuid': '11dc4450-74e9-48ab-9de3-024baa6af9f1'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:50 user nova-compute[71711]: INFO os_vif [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=3abeb81f-8a9b-40c6-a526-7a10818160b0,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3abeb81f-8a')
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] No VIF found with MAC fa:16:3e:15:f9:0a, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:29:50 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Updating instance_info_cache with network_info: [{"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG nova.compute.manager [req-7777600f-11e6-45f9-b615-22f2fc44cdd2 req-8d761a53-ce47-444d-a0b6-19551cbf0d15 service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Received event network-vif-plugged-3abeb81f-8a9b-40c6-a526-7a10818160b0 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7777600f-11e6-45f9-b615-22f2fc44cdd2 req-8d761a53-ce47-444d-a0b6-19551cbf0d15 service nova] Acquiring lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7777600f-11e6-45f9-b615-22f2fc44cdd2 req-8d761a53-ce47-444d-a0b6-19551cbf0d15 service nova] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7777600f-11e6-45f9-b615-22f2fc44cdd2 req-8d761a53-ce47-444d-a0b6-19551cbf0d15 service nova] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG nova.compute.manager [req-7777600f-11e6-45f9-b615-22f2fc44cdd2 req-8d761a53-ce47-444d-a0b6-19551cbf0d15 service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] No waiting events found dispatching network-vif-plugged-3abeb81f-8a9b-40c6-a526-7a10818160b0 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:29:51 user nova-compute[71711]: WARNING nova.compute.manager [req-7777600f-11e6-45f9-b615-22f2fc44cdd2 req-8d761a53-ce47-444d-a0b6-19551cbf0d15 service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Received unexpected event network-vif-plugged-3abeb81f-8a9b-40c6-a526-7a10818160b0 for instance with vm_state building and task_state spawning.
Apr 12 06:29:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280993.5737238, 11dc4450-74e9-48ab-9de3-024baa6af9f1 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:29:53 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] VM Resumed (Lifecycle Event)
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:29:53 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Instance spawned successfully.
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:29:53 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681280993.575415, 11dc4450-74e9-48ab-9de3-024baa6af9f1 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:29:53 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] VM Started (Lifecycle Event)
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681280978.6351783, a528e600-7358-4b92-9b71-12759f405b38 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:29:53 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: a528e600-7358-4b92-9b71-12759f405b38] VM Stopped (Lifecycle Event)
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d3de5f7e-721c-4df0-9066-6195b268da41 None None] [instance: a528e600-7358-4b92-9b71-12759f405b38] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-b94bc081-84b0-4eed-a8a2-aaa468031626 req-50ec5d66-cde3-4341-b5a5-06c9fe9a50ac service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Received event network-vif-plugged-3abeb81f-8a9b-40c6-a526-7a10818160b0 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b94bc081-84b0-4eed-a8a2-aaa468031626 req-50ec5d66-cde3-4341-b5a5-06c9fe9a50ac service nova] Acquiring lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b94bc081-84b0-4eed-a8a2-aaa468031626 req-50ec5d66-cde3-4341-b5a5-06c9fe9a50ac service nova] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b94bc081-84b0-4eed-a8a2-aaa468031626 req-50ec5d66-cde3-4341-b5a5-06c9fe9a50ac service nova] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-b94bc081-84b0-4eed-a8a2-aaa468031626 req-50ec5d66-cde3-4341-b5a5-06c9fe9a50ac service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] No waiting events found dispatching network-vif-plugged-3abeb81f-8a9b-40c6-a526-7a10818160b0 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:29:53 user nova-compute[71711]: WARNING nova.compute.manager [req-b94bc081-84b0-4eed-a8a2-aaa468031626 req-50ec5d66-cde3-4341-b5a5-06c9fe9a50ac service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Received unexpected event network-vif-plugged-3abeb81f-8a9b-40c6-a526-7a10818160b0 for instance with vm_state building and task_state spawning.
Apr 12 06:29:53 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:29:53 user nova-compute[71711]: INFO nova.compute.manager [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Took 6.12 seconds to spawn the instance on the hypervisor.
Apr 12 06:29:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:29:53 user nova-compute[71711]: INFO nova.compute.manager [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Took 6.97 seconds to build instance.
Apr 12 06:29:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-519a42ad-34b2-4c2e-8d20-c87252f538c0 tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.067s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:29:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:29:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:17 user nova-compute[71711]: INFO nova.compute.manager [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Rescuing
Apr 12 06:30:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:30:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquired lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:30:17 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:30:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "46b32f3f-86c4-450a-a710-7d0c05ea4097" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:17 user nova-compute[71711]: INFO nova.compute.manager [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Terminating instance
Apr 12 06:30:17 user nova-compute[71711]: DEBUG nova.compute.manager [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:30:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-90becebc-c3e7-41ea-8170-1364a219520e req-30986f69-4678-4863-ae39-6a5a52f0fc43 service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Received event network-vif-unplugged-33f085d7-b843-4c48-8379-a5c2690a4231 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-90becebc-c3e7-41ea-8170-1364a219520e req-30986f69-4678-4863-ae39-6a5a52f0fc43 service nova] Acquiring lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-90becebc-c3e7-41ea-8170-1364a219520e req-30986f69-4678-4863-ae39-6a5a52f0fc43 service nova] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-90becebc-c3e7-41ea-8170-1364a219520e req-30986f69-4678-4863-ae39-6a5a52f0fc43 service nova] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-90becebc-c3e7-41ea-8170-1364a219520e req-30986f69-4678-4863-ae39-6a5a52f0fc43 service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] No waiting events found dispatching network-vif-unplugged-33f085d7-b843-4c48-8379-a5c2690a4231 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-90becebc-c3e7-41ea-8170-1364a219520e req-30986f69-4678-4863-ae39-6a5a52f0fc43 service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Received event network-vif-unplugged-33f085d7-b843-4c48-8379-a5c2690a4231 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.network.neutron [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Updating instance_info_cache with network_info: [{"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Releasing lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:30:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Instance destroyed successfully.
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.objects.instance [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lazy-loading 'resources' on Instance uuid 46b32f3f-86c4-450a-a710-7d0c05ea4097 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2118576466',display_name='tempest-ServersNegativeTestJSON-server-2118576466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2118576466',id=1,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:21:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbca90b5b5fb49ca857aa4e215a99e37',ramdisk_id='',reservation_id='r-gpn11dzi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-815999574',owner_user_name='tempest-ServersNegativeTestJSON-815999574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:21:54Z,user_data=None,user_id='e761442395d14d7f82216e3d4174e43a',uuid=46b32f3f-86c4-450a-a710-7d0c05ea4097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33f085d7-b843-4c48-8379-a5c2690a4231", "address": "fa:16:3e:4e:28:c3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f085d7-b8", "ovs_interfaceid": "33f085d7-b843-4c48-8379-a5c2690a4231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Converting VIF {"id": "33f085d7-b843-4c48-8379-a5c2690a4231", "address": "fa:16:3e:4e:28:c3", "network": {"id": "c388c547-af8b-4a08-a268-43eb751fa0c1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1225965230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbca90b5b5fb49ca857aa4e215a99e37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33f085d7-b8", "ovs_interfaceid": "33f085d7-b843-4c48-8379-a5c2690a4231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:28:c3,bridge_name='br-int',has_traffic_filtering=True,id=33f085d7-b843-4c48-8379-a5c2690a4231,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f085d7-b8') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG os_vif [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:28:c3,bridge_name='br-int',has_traffic_filtering=True,id=33f085d7-b843-4c48-8379-a5c2690a4231,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f085d7-b8') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33f085d7-b8, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:30:18 user nova-compute[71711]: INFO os_vif [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:28:c3,bridge_name='br-int',has_traffic_filtering=True,id=33f085d7-b843-4c48-8379-a5c2690a4231,network=Network(c388c547-af8b-4a08-a268-43eb751fa0c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33f085d7-b8')
Apr 12 06:30:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Deleting instance files /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097_del
Apr 12 06:30:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Deletion of /opt/stack/data/nova/instances/46b32f3f-86c4-450a-a710-7d0c05ea4097_del complete
Apr 12 06:30:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:18 user nova-compute[71711]: INFO nova.compute.manager [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Took 0.73 seconds to destroy the instance on the hypervisor.
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-17b68aab-5c60-4be9-9da9-4457fc0fca54 req-d9af99fa-95fa-475b-855e-7fa381cc626f service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received event network-vif-unplugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-17b68aab-5c60-4be9-9da9-4457fc0fca54 req-d9af99fa-95fa-475b-855e-7fa381cc626f service nova] Acquiring lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-17b68aab-5c60-4be9-9da9-4457fc0fca54 req-d9af99fa-95fa-475b-855e-7fa381cc626f service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-17b68aab-5c60-4be9-9da9-4457fc0fca54 req-d9af99fa-95fa-475b-855e-7fa381cc626f service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-17b68aab-5c60-4be9-9da9-4457fc0fca54 req-d9af99fa-95fa-475b-855e-7fa381cc626f service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] No waiting events found dispatching network-vif-unplugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:18 user nova-compute[71711]: WARNING nova.compute.manager [req-17b68aab-5c60-4be9-9da9-4457fc0fca54 req-d9af99fa-95fa-475b-855e-7fa381cc626f service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received unexpected event network-vif-unplugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance with vm_state active and task_state rescuing.
Apr 12 06:30:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Instance destroyed successfully.
Apr 12 06:30:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Attempting rescue
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71711) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Instance directory exists: not creating {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 06:30:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Creating image(s)
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "/opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "/opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "/opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'trusted_certs' on Instance uuid c64aff93-15fa-4520-b6ac-cdcacb49478e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.161s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue" returned: 0 in 0.050s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'migration_context' on Instance uuid c64aff93-15fa-4520-b6ac-cdcacb49478e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Start _get_guest_xml network_info=[{"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "vif_mac": "fa:16:3e:92:30:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'resources' on Instance uuid c64aff93-15fa-4520-b6ac-cdcacb49478e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'numa_topology' on Instance uuid c64aff93-15fa-4520-b6ac-cdcacb49478e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:19 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:30:19 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'vcpu_model' on Instance uuid c64aff93-15fa-4520-b6ac-cdcacb49478e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-335972391',display_name='tempest-ServerRescueNegativeTestJSON-server-335972391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-335972391',id=18,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:28:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='972842dc32ee4687866dfe2fbefe9cb4',ramdisk_id='',reservation_id='r-dv6aie1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1179647693',owner_user_name='tempest-ServerRescueNegativeTestJSON-1179647693-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:28:35Z,user_data=None,user_id='dc8e6af1db834409a4880040a5ef6a5a',uuid=c64aff93-15fa-4520-b6ac-cdcacb49478e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "vif_mac": "fa:16:3e:92:30:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converting VIF {"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "vif_mac": "fa:16:3e:92:30:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:30:50,bridge_name='br-int',has_traffic_filtering=True,id=6649e98a-d7bc-4e7a-ab8b-d00622606a3b,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6649e98a-d7') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'pci_devices' on Instance uuid c64aff93-15fa-4520-b6ac-cdcacb49478e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:30:19 user nova-compute[71711]:   <uuid>c64aff93-15fa-4520-b6ac-cdcacb49478e</uuid>
Apr 12 06:30:19 user nova-compute[71711]:   <name>instance-00000012</name>
Apr 12 06:30:19 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:30:19 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:30:19 user nova-compute[71711]:   <metadata>
Apr 12 06:30:19 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:30:19 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:30:19 user nova-compute[71711]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-335972391</nova:name>
Apr 12 06:30:19 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:30:19</nova:creationTime>
Apr 12 06:30:19 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:30:19 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:30:19 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:30:19 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:30:19 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:30:19 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:30:19 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:30:19 user nova-compute[71711]:       <nova:owner>
Apr 12 06:30:19 user nova-compute[71711]:         <nova:user uuid="dc8e6af1db834409a4880040a5ef6a5a">tempest-ServerRescueNegativeTestJSON-1179647693-project-member</nova:user>
Apr 12 06:30:19 user nova-compute[71711]:         <nova:project uuid="972842dc32ee4687866dfe2fbefe9cb4">tempest-ServerRescueNegativeTestJSON-1179647693</nova:project>
Apr 12 06:30:19 user nova-compute[71711]:       </nova:owner>
Apr 12 06:30:19 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:30:19 user nova-compute[71711]:       <nova:ports>
Apr 12 06:30:19 user nova-compute[71711]:         <nova:port uuid="6649e98a-d7bc-4e7a-ab8b-d00622606a3b">
Apr 12 06:30:19 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 06:30:19 user nova-compute[71711]:         </nova:port>
Apr 12 06:30:19 user nova-compute[71711]:       </nova:ports>
Apr 12 06:30:19 user nova-compute[71711]:     </nova:instance>
Apr 12 06:30:19 user nova-compute[71711]:   </metadata>
Apr 12 06:30:19 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:30:19 user nova-compute[71711]:     <system>
Apr 12 06:30:19 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:30:19 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:30:19 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:30:19 user nova-compute[71711]:       <entry name="serial">c64aff93-15fa-4520-b6ac-cdcacb49478e</entry>
Apr 12 06:30:19 user nova-compute[71711]:       <entry name="uuid">c64aff93-15fa-4520-b6ac-cdcacb49478e</entry>
Apr 12 06:30:19 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:30:19 user nova-compute[71711]:     </system>
Apr 12 06:30:19 user nova-compute[71711]:   </sysinfo>
Apr 12 06:30:19 user nova-compute[71711]:   <os>
Apr 12 06:30:19 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:30:19 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:30:19 user nova-compute[71711]:   </os>
Apr 12 06:30:19 user nova-compute[71711]:   <features>
Apr 12 06:30:19 user nova-compute[71711]:     <acpi/>
Apr 12 06:30:19 user nova-compute[71711]:     <apic/>
Apr 12 06:30:19 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:30:19 user nova-compute[71711]:   </features>
Apr 12 06:30:19 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:30:19 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:30:19 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:30:19 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:30:19 user nova-compute[71711]:   </clock>
Apr 12 06:30:19 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:30:19 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:30:19 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:30:19 user nova-compute[71711]:   </cpu>
Apr 12 06:30:19 user nova-compute[71711]:   <devices>
Apr 12 06:30:19 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:30:19 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:30:19 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue"/>
Apr 12 06:30:19 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:30:19 user nova-compute[71711]:     </disk>
Apr 12 06:30:19 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:30:19 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:30:19 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk"/>
Apr 12 06:30:19 user nova-compute[71711]:       <target dev="vdb" bus="virtio"/>
Apr 12 06:30:19 user nova-compute[71711]:     </disk>
Apr 12 06:30:19 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:30:19 user nova-compute[71711]:       <mac address="fa:16:3e:92:30:50"/>
Apr 12 06:30:19 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:30:19 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:30:19 user nova-compute[71711]:       <target dev="tap6649e98a-d7"/>
Apr 12 06:30:19 user nova-compute[71711]:     </interface>
Apr 12 06:30:19 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:30:19 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/console.log" append="off"/>
Apr 12 06:30:19 user nova-compute[71711]:     </serial>
Apr 12 06:30:19 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:30:19 user nova-compute[71711]:     <video>
Apr 12 06:30:19 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:30:19 user nova-compute[71711]:     </video>
Apr 12 06:30:19 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:30:19 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:30:19 user nova-compute[71711]:     </rng>
Apr 12 06:30:19 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:30:19 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:30:19 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:30:19 user nova-compute[71711]:     </memballoon>
Apr 12 06:30:19 user nova-compute[71711]:   </devices>
Apr 12 06:30:19 user nova-compute[71711]: </domain>
Apr 12 06:30:19 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:30:19 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Instance destroyed successfully.
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No VIF found with MAC fa:16:3e:92:30:50, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:30:19 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Took 1.07 seconds to deallocate network for instance.
Apr 12 06:30:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:30:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:19 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Deleted allocations for instance 46b32f3f-86c4-450a-a710-7d0c05ea4097
Apr 12 06:30:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-009e356f-bd2a-4a7f-b423-b6520e5195e7 tempest-ServersNegativeTestJSON-815999574 tempest-ServersNegativeTestJSON-815999574-project-member] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.354s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-d8e95b4f-55a8-49f1-b9b6-6a8137915119 req-acc6f479-6f39-4d3d-89ad-6a1949ba99c9 service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Received event network-vif-plugged-33f085d7-b843-4c48-8379-a5c2690a4231 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d8e95b4f-55a8-49f1-b9b6-6a8137915119 req-acc6f479-6f39-4d3d-89ad-6a1949ba99c9 service nova] Acquiring lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d8e95b4f-55a8-49f1-b9b6-6a8137915119 req-acc6f479-6f39-4d3d-89ad-6a1949ba99c9 service nova] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d8e95b4f-55a8-49f1-b9b6-6a8137915119 req-acc6f479-6f39-4d3d-89ad-6a1949ba99c9 service nova] Lock "46b32f3f-86c4-450a-a710-7d0c05ea4097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-d8e95b4f-55a8-49f1-b9b6-6a8137915119 req-acc6f479-6f39-4d3d-89ad-6a1949ba99c9 service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] No waiting events found dispatching network-vif-plugged-33f085d7-b843-4c48-8379-a5c2690a4231 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:20 user nova-compute[71711]: WARNING nova.compute.manager [req-d8e95b4f-55a8-49f1-b9b6-6a8137915119 req-acc6f479-6f39-4d3d-89ad-6a1949ba99c9 service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Received unexpected event network-vif-plugged-33f085d7-b843-4c48-8379-a5c2690a4231 for instance with vm_state deleted and task_state None.
Apr 12 06:30:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received event network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] Acquiring lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] No waiting events found dispatching network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:21 user nova-compute[71711]: WARNING nova.compute.manager [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received unexpected event network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance with vm_state active and task_state rescuing.
Apr 12 06:30:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-3a1373c6-52e2-4361-aa83-2c704459625e req-dc77b429-33a3-4d22-ac16-8babf1493197 service nova] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Received event network-vif-deleted-33f085d7-b843-4c48-8379-a5c2690a4231 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for c64aff93-15fa-4520-b6ac-cdcacb49478e due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:30:22 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281022.875535, c64aff93-15fa-4520-b6ac-cdcacb49478e => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:30:22 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] VM Resumed (Lifecycle Event)
Apr 12 06:30:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e6870ce2-a542-4efd-b38d-7ec4b8c79c62 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:30:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:30:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:30:22 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 06:30:22 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281022.8794513, c64aff93-15fa-4520-b6ac-cdcacb49478e => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:30:22 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] VM Started (Lifecycle Event)
Apr 12 06:30:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:30:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:30:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received event network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] Acquiring lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] No waiting events found dispatching network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:23 user nova-compute[71711]: WARNING nova.compute.manager [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received unexpected event network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance with vm_state rescued and task_state None.
Apr 12 06:30:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received event network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] Acquiring lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] No waiting events found dispatching network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:23 user nova-compute[71711]: WARNING nova.compute.manager [req-8f6c3e5c-2f4f-45c8-bb09-9f335aff1710 req-79896f22-5a8f-4001-9f39-c871d8c78739 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received unexpected event network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance with vm_state rescued and task_state None.
Apr 12 06:30:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG nova.objects.instance [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'flavor' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281018.2906954, 46b32f3f-86c4-450a-a710-7d0c05ea4097 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:30:33 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] VM Stopped (Lifecycle Event)
Apr 12 06:30:33 user nova-compute[71711]: DEBUG nova.compute.manager [None req-37250d8a-5621-42f9-9ee1-be3c689c0d42 None None] [instance: 46b32f3f-86c4-450a-a710-7d0c05ea4097] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:33 user nova-compute[71711]: INFO nova.compute.manager [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Attaching volume c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 to /dev/vdb
Apr 12 06:30:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG os_brick.utils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c5f7f5-222e-4bae-9176-866e81c32234]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf362ab-bc8c-45b1-bb4e-9752d4c51084]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5029f9-daf9-43a3-9911-c209b2bbd68c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b528e43-77df-4045-bea2-ed1ba5a98847]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:30:33 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:30:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e952b367-9c82-4388-8c1a-1cba60b84fe5]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG os_brick.utils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating existing volume attachment record: 9d6c1587-9572-404c-895e-3914f35401d9 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:30:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:30:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:36 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:30:36 user nova-compute[71711]: INFO nova.compute.claims [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Claim successful on node user
Apr 12 06:30:37 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG nova.network.neutron [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:30:37 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:30:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG nova.policy [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '549eaf8464b64c96ab3c6dde394cc31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebdd9f4006d413686bba37f22374759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:30:37 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Creating image(s)
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "/opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "/opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "/opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.177s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk 1073741824" returned: 0 in 0.056s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:30:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Cannot resize image /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG nova.objects.instance [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'migration_context' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Ensure instance console log exists: /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:30:38 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:30:38 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:30:38 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG nova.network.neutron [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Successfully created port: 8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[316aad9d-35c0-47f5-8463-2c2708a05473]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:30:38 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e67a68-d2ab-4c2a-8b79-3ad4abe0ad0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7] added
Apr 12 06:30:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdebf841-2ee3-4783-b256-1e5856b372bf]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a324e28f-21b3-43e1-b23c-79a254674bcd]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akKCItqp {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akKCItqp" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ad6e4f-fc00-4e33-bf96-12d0b642374d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'akKCItqp'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d9c41c-1078-4827-97cd-653b64b39b00]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d815984b-4e39-4804-aa98-165d9c054db8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:30:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:30:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[df35833e-6499-4fa6-9594-534473a90b08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260]
Apr 12 06:30:38 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260] successful.
Apr 12 06:30:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7438c098-1846-4f7f-a550-2bf5111f845d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[28128d48-81fa-46fd-9915-73f08c48716d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:30:38 user nova-compute[71711]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:30:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:30:38 user nova-compute[71711]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:30:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29375d8-05fc-41fd-af7a-8f4f68d74502]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG nova.network.neutron [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Successfully updated port: 8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "refresh_cache-3770a397-2124-4648-abad-d3ce6483e3b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquired lock "refresh_cache-3770a397-2124-4648-abad-d3ce6483e3b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG nova.network.neutron [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Received event network-changed-8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Refreshing instance network info cache due to event network-changed-8bb8777b-5b83-47be-ab13-4ad7fd67d66c. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:30:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] Acquiring lock "refresh_cache-3770a397-2124-4648-abad-d3ce6483e3b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.network.neutron [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.network.neutron [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Updating instance_info_cache with network_info: [{"id": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "address": "fa:16:3e:5b:66:97", "network": {"id": "4d619acb-e553-4fd8-ab04-623325eaf182", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-502354801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebdd9f4006d413686bba37f22374759", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8777b-5b", "ovs_interfaceid": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Releasing lock "refresh_cache-3770a397-2124-4648-abad-d3ce6483e3b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.compute.manager [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Instance network_info: |[{"id": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "address": "fa:16:3e:5b:66:97", "network": {"id": "4d619acb-e553-4fd8-ab04-623325eaf182", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-502354801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebdd9f4006d413686bba37f22374759", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8777b-5b", "ovs_interfaceid": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] Acquired lock "refresh_cache-3770a397-2124-4648-abad-d3ce6483e3b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.network.neutron [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Refreshing network info cache for port 8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Start _get_guest_xml network_info=[{"id": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "address": "fa:16:3e:5b:66:97", "network": {"id": "4d619acb-e553-4fd8-ab04-623325eaf182", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-502354801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebdd9f4006d413686bba37f22374759", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8777b-5b", "ovs_interfaceid": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:30:39 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:30:39 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1794952988',display_name='tempest-SnapshotDataIntegrityTests-server-1794952988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1794952988',id=22,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcgEQFNhIVnT0wxBESUjSnWt8fLNeSczeXi75jsZIJIsHDY3ZCw0iL7p7oChBDAewN3LU2kaBsEIsgV6dzIxe4HbSqe0jpOsMXcUoleoH69sicZfwxhtmAiR7pt/liSYQ==',key_name='tempest-SnapshotDataIntegrityTests-2112427330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ebdd9f4006d413686bba37f22374759',ramdisk_id='',reservation_id='r-8o3jne48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2082659614',owner_user_name='tempest-SnapshotDataIntegrityTests-2082659614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:30:37Z,user_data=None,user_id='549eaf8464b64c96ab3c6dde394cc31e',uuid=3770a397-2124-4648-abad-d3ce6483e3b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "address": "fa:16:3e:5b:66:97", "network": {"id": "4d619acb-e553-4fd8-ab04-623325eaf182", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-502354801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebdd9f4006d413686bba37f22374759", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8777b-5b", "ovs_interfaceid": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Converting VIF {"id": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "address": "fa:16:3e:5b:66:97", "network": {"id": "4d619acb-e553-4fd8-ab04-623325eaf182", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-502354801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebdd9f4006d413686bba37f22374759", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8777b-5b", "ovs_interfaceid": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:66:97,bridge_name='br-int',has_traffic_filtering=True,id=8bb8777b-5b83-47be-ab13-4ad7fd67d66c,network=Network(4d619acb-e553-4fd8-ab04-623325eaf182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8777b-5b') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.objects.instance [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'pci_devices' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:30:39 user nova-compute[71711]:   <uuid>3770a397-2124-4648-abad-d3ce6483e3b2</uuid>
Apr 12 06:30:39 user nova-compute[71711]:   <name>instance-00000016</name>
Apr 12 06:30:39 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:30:39 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:30:39 user nova-compute[71711]:   <metadata>
Apr 12 06:30:39 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:30:39 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:30:39 user nova-compute[71711]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1794952988</nova:name>
Apr 12 06:30:39 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:30:39</nova:creationTime>
Apr 12 06:30:39 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:30:39 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:30:39 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:30:39 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:30:39 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:30:39 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:30:39 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:30:39 user nova-compute[71711]:       <nova:owner>
Apr 12 06:30:39 user nova-compute[71711]:         <nova:user uuid="549eaf8464b64c96ab3c6dde394cc31e">tempest-SnapshotDataIntegrityTests-2082659614-project-member</nova:user>
Apr 12 06:30:39 user nova-compute[71711]:         <nova:project uuid="1ebdd9f4006d413686bba37f22374759">tempest-SnapshotDataIntegrityTests-2082659614</nova:project>
Apr 12 06:30:39 user nova-compute[71711]:       </nova:owner>
Apr 12 06:30:39 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:30:39 user nova-compute[71711]:       <nova:ports>
Apr 12 06:30:39 user nova-compute[71711]:         <nova:port uuid="8bb8777b-5b83-47be-ab13-4ad7fd67d66c">
Apr 12 06:30:39 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 06:30:39 user nova-compute[71711]:         </nova:port>
Apr 12 06:30:39 user nova-compute[71711]:       </nova:ports>
Apr 12 06:30:39 user nova-compute[71711]:     </nova:instance>
Apr 12 06:30:39 user nova-compute[71711]:   </metadata>
Apr 12 06:30:39 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:30:39 user nova-compute[71711]:     <system>
Apr 12 06:30:39 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:30:39 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:30:39 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:30:39 user nova-compute[71711]:       <entry name="serial">3770a397-2124-4648-abad-d3ce6483e3b2</entry>
Apr 12 06:30:39 user nova-compute[71711]:       <entry name="uuid">3770a397-2124-4648-abad-d3ce6483e3b2</entry>
Apr 12 06:30:39 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:30:39 user nova-compute[71711]:     </system>
Apr 12 06:30:39 user nova-compute[71711]:   </sysinfo>
Apr 12 06:30:39 user nova-compute[71711]:   <os>
Apr 12 06:30:39 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:30:39 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:30:39 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:30:39 user nova-compute[71711]:   </os>
Apr 12 06:30:39 user nova-compute[71711]:   <features>
Apr 12 06:30:39 user nova-compute[71711]:     <acpi/>
Apr 12 06:30:39 user nova-compute[71711]:     <apic/>
Apr 12 06:30:39 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:30:39 user nova-compute[71711]:   </features>
Apr 12 06:30:39 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:30:39 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:30:39 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:30:39 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:30:39 user nova-compute[71711]:   </clock>
Apr 12 06:30:39 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:30:39 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:30:39 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:30:39 user nova-compute[71711]:   </cpu>
Apr 12 06:30:39 user nova-compute[71711]:   <devices>
Apr 12 06:30:39 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:30:39 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:30:39 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk"/>
Apr 12 06:30:39 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:30:39 user nova-compute[71711]:     </disk>
Apr 12 06:30:39 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:30:39 user nova-compute[71711]:       <mac address="fa:16:3e:5b:66:97"/>
Apr 12 06:30:39 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:30:39 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:30:39 user nova-compute[71711]:       <target dev="tap8bb8777b-5b"/>
Apr 12 06:30:39 user nova-compute[71711]:     </interface>
Apr 12 06:30:39 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:30:39 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/console.log" append="off"/>
Apr 12 06:30:39 user nova-compute[71711]:     </serial>
Apr 12 06:30:39 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:30:39 user nova-compute[71711]:     <video>
Apr 12 06:30:39 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:30:39 user nova-compute[71711]:     </video>
Apr 12 06:30:39 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:30:39 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:30:39 user nova-compute[71711]:     </rng>
Apr 12 06:30:39 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:30:39 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:30:39 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:30:39 user nova-compute[71711]:     </memballoon>
Apr 12 06:30:39 user nova-compute[71711]:   </devices>
Apr 12 06:30:39 user nova-compute[71711]: </domain>
Apr 12 06:30:39 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1794952988',display_name='tempest-SnapshotDataIntegrityTests-server-1794952988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1794952988',id=22,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcgEQFNhIVnT0wxBESUjSnWt8fLNeSczeXi75jsZIJIsHDY3ZCw0iL7p7oChBDAewN3LU2kaBsEIsgV6dzIxe4HbSqe0jpOsMXcUoleoH69sicZfwxhtmAiR7pt/liSYQ==',key_name='tempest-SnapshotDataIntegrityTests-2112427330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ebdd9f4006d413686bba37f22374759',ramdisk_id='',reservation_id='r-8o3jne48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2082659614',owner_user_name='tempest-SnapshotDataIntegrityTests-2082659614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:30:37Z,user_data=None,user_id='549eaf8464b64c96ab3c6dde394cc31e',uuid=3770a397-2124-4648-abad-d3ce6483e3b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "address": "fa:16:3e:5b:66:97", "network": {"id": "4d619acb-e553-4fd8-ab04-623325eaf182", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-502354801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebdd9f4006d413686bba37f22374759", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8777b-5b", "ovs_interfaceid": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Converting VIF {"id": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "address": "fa:16:3e:5b:66:97", "network": {"id": "4d619acb-e553-4fd8-ab04-623325eaf182", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-502354801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebdd9f4006d413686bba37f22374759", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8777b-5b", "ovs_interfaceid": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:66:97,bridge_name='br-int',has_traffic_filtering=True,id=8bb8777b-5b83-47be-ab13-4ad7fd67d66c,network=Network(4d619acb-e553-4fd8-ab04-623325eaf182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8777b-5b') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG os_vif [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:66:97,bridge_name='br-int',has_traffic_filtering=True,id=8bb8777b-5b83-47be-ab13-4ad7fd67d66c,network=Network(4d619acb-e553-4fd8-ab04-623325eaf182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8777b-5b') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bb8777b-5b, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8bb8777b-5b, col_values=(('external_ids', {'iface-id': '8bb8777b-5b83-47be-ab13-4ad7fd67d66c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:66:97', 'vm-uuid': '3770a397-2124-4648-abad-d3ce6483e3b2'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:39 user nova-compute[71711]: INFO os_vif [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:66:97,bridge_name='br-int',has_traffic_filtering=True,id=8bb8777b-5b83-47be-ab13-4ad7fd67d66c,network=Network(4d619acb-e553-4fd8-ab04-623325eaf182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8777b-5b')
Apr 12 06:30:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26538346464396661', 'path': '/dev/sdc'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538346464396661', 'path': '/dev/sdc'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.objects.instance [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'flavor' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No VIF found with MAC fa:16:3e:5b:66:97, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:30:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:30:39 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:30:39 user nova-compute[71711]:   <source dev="/dev/sdc"/>
Apr 12 06:30:39 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:30:39 user nova-compute[71711]:   <serial>c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7</serial>
Apr 12 06:30:39 user nova-compute[71711]: </disk>
Apr 12 06:30:39 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:30:40 user nova-compute[71711]: DEBUG nova.network.neutron [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Updated VIF entry in instance network info cache for port 8bb8777b-5b83-47be-ab13-4ad7fd67d66c. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:30:40 user nova-compute[71711]: DEBUG nova.network.neutron [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Updating instance_info_cache with network_info: [{"id": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "address": "fa:16:3e:5b:66:97", "network": {"id": "4d619acb-e553-4fd8-ab04-623325eaf182", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-502354801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebdd9f4006d413686bba37f22374759", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8777b-5b", "ovs_interfaceid": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:30:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-77f07b43-6c0f-4f1c-943f-10d099f66a07 req-ed279a46-2112-4190-a6a3-a65d1eb5eb95 service nova] Releasing lock "refresh_cache-3770a397-2124-4648-abad-d3ce6483e3b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:30:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:30:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:30:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No VIF found with MAC fa:16:3e:7c:bb:4d, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:30:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0e1cff2b-499a-416a-bd5f-4ceecee1e13a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-5c0d7a9a-edc4-4872-9d79-b4f15af61f27 req-db84bda6-0993-44e5-b4f6-2f15acde60bb service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Received event network-vif-plugged-8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5c0d7a9a-edc4-4872-9d79-b4f15af61f27 req-db84bda6-0993-44e5-b4f6-2f15acde60bb service nova] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5c0d7a9a-edc4-4872-9d79-b4f15af61f27 req-db84bda6-0993-44e5-b4f6-2f15acde60bb service nova] Lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5c0d7a9a-edc4-4872-9d79-b4f15af61f27 req-db84bda6-0993-44e5-b4f6-2f15acde60bb service nova] Lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-5c0d7a9a-edc4-4872-9d79-b4f15af61f27 req-db84bda6-0993-44e5-b4f6-2f15acde60bb service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] No waiting events found dispatching network-vif-plugged-8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:41 user nova-compute[71711]: WARNING nova.compute.manager [req-5c0d7a9a-edc4-4872-9d79-b4f15af61f27 req-db84bda6-0993-44e5-b4f6-2f15acde60bb service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Received unexpected event network-vif-plugged-8bb8777b-5b83-47be-ab13-4ad7fd67d66c for instance with vm_state building and task_state spawning.
Apr 12 06:30:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:42 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Stashing vm_state: active {{(pid=71711) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 06:30:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'pci_requests' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:30:42 user nova-compute[71711]: INFO nova.compute.claims [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Claim successful on node user
Apr 12 06:30:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'resources' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:42 user nova-compute[71711]: INFO nova.compute.resource_tracker [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating resource usage from migration b40fbccb-d98f-4362-982f-4301471b7325
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.470s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:43 user nova-compute[71711]: INFO nova.compute.manager [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Migrating
Apr 12 06:30:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:30:43 user nova-compute[71711]: INFO nova.compute.rpcapi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 12 06:30:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquired lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281043.4292424, 3770a397-2124-4648-abad-d3ce6483e3b2 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:30:43 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] VM Resumed (Lifecycle Event)
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:30:43 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Instance spawned successfully.
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:30:43 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281043.4318147, 3770a397-2124-4648-abad-d3ce6483e3b2 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:30:43 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] VM Started (Lifecycle Event)
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-e0c731b3-ad7b-43ba-b445-f556566c8933 req-0636cef6-bdb2-4cdc-b3a5-7e749f495343 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Received event network-vif-plugged-8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e0c731b3-ad7b-43ba-b445-f556566c8933 req-0636cef6-bdb2-4cdc-b3a5-7e749f495343 service nova] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e0c731b3-ad7b-43ba-b445-f556566c8933 req-0636cef6-bdb2-4cdc-b3a5-7e749f495343 service nova] Lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e0c731b3-ad7b-43ba-b445-f556566c8933 req-0636cef6-bdb2-4cdc-b3a5-7e749f495343 service nova] Lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-e0c731b3-ad7b-43ba-b445-f556566c8933 req-0636cef6-bdb2-4cdc-b3a5-7e749f495343 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] No waiting events found dispatching network-vif-plugged-8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:43 user nova-compute[71711]: WARNING nova.compute.manager [req-e0c731b3-ad7b-43ba-b445-f556566c8933 req-0636cef6-bdb2-4cdc-b3a5-7e749f495343 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Received unexpected event network-vif-plugged-8bb8777b-5b83-47be-ab13-4ad7fd67d66c for instance with vm_state building and task_state spawning.
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:30:43 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:30:43 user nova-compute[71711]: INFO nova.compute.manager [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Took 6.12 seconds to spawn the instance on the hypervisor.
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating instance_info_cache with network_info: [{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Releasing lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:30:43 user nova-compute[71711]: INFO nova.compute.manager [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Took 6.88 seconds to build instance.
Apr 12 06:30:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-875cbbdb-023d-4c61-9c04-cfb862f0e939 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.995s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Starting migrate_disk_and_power_off {{(pid=71711) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-15a4b558-b789-4cf5-a399-47dd06e332c5 req-eab62486-66d6-4117-9f17-49155111dc67 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-15a4b558-b789-4cf5-a399-47dd06e332c5 req-eab62486-66d6-4117-9f17-49155111dc67 service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-15a4b558-b789-4cf5-a399-47dd06e332c5 req-eab62486-66d6-4117-9f17-49155111dc67 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-15a4b558-b789-4cf5-a399-47dd06e332c5 req-eab62486-66d6-4117-9f17-49155111dc67 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-15a4b558-b789-4cf5-a399-47dd06e332c5 req-eab62486-66d6-4117-9f17-49155111dc67 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:44 user nova-compute[71711]: WARNING nova.compute.manager [req-15a4b558-b789-4cf5-a399-47dd06e332c5 req-eab62486-66d6-4117-9f17-49155111dc67 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state active and task_state resize_migrating.
Apr 12 06:30:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance destroyed successfully.
Apr 12 06:30:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1807692588',display_name='tempest-ServerActionsTestJSON-server-1279128249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1807692588',id=4,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:26:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-hktvsdi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=5b5758b9-4f7e-4e85-8181-e3dfdd84e624,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7c:bb:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7c:bb:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_vif [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fba3fe8-62, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:44 user nova-compute[71711]: INFO os_vif [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62')
Apr 12 06:30:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:30:44 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[922f42b0-6598-4b80-9f4e-b01bb7d0d4ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:30:44 user nova-compute[71711]: No targets found.
Apr 12 06:30:44 user nova-compute[71711]: iSNS:
Apr 12 06:30:44 user nova-compute[71711]: No targets found.
Apr 12 06:30:44 user nova-compute[71711]: STATIC:
Apr 12 06:30:44 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7
Apr 12 06:30:44 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:30:44 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:30:44 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:30:44 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:30:44 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:30:44 user nova-compute[71711]: FIRMWARE:
Apr 12 06:30:44 user nova-compute[71711]: No targets found.
Apr 12 06:30:44 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:30:44 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:30:44 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9660957-f9c2-4392-bd3a-d6397ef6c058]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be5a682-aedb-49ae-ac15-0becd73d6c7e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:30:44 user nova-compute[71711]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:30:44 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:30:44 user nova-compute[71711]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:30:44 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c142710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7'): ({'sdc'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Removing single pathed devices sdc {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fff932-03b4-48c3-b6e2-a6b980750e0e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5080404b-9f6c-4e01-b869-34edbf8af333]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flushing IO for device /dev/sdc {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a7816e-6f1b-417c-a93e-5a168b11e6c2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c2fa15-8f04-4144-84a3-558bf7c26763]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e76f4d-6543-45fe-af9d-a88152ed6fed]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe0c7ef-aa8c-46d4-8c77-5d2284a40878]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260]
Apr 12 06:30:45 user nova-compute[71711]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260] successful.
Apr 12 06:30:45 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d45e2fb-0d06-4bfc-be3b-e34ef3243b37]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== disconnect_volume: return (328ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624_resize/disk /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "cp -r /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624_resize/disk /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk" returned: 0 in 0.318s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624_resize/disk.info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk.info {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "cp -r /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624_resize/disk.info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk.info" returned: 0 in 0.033s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:46 user nova-compute[71711]: WARNING nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state active and task_state resize_migrating.
Apr 12 06:30:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:46 user nova-compute[71711]: WARNING nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state active and task_state resize_migrating.
Apr 12 06:30:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:46 user nova-compute[71711]: WARNING nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state active and task_state resize_migrating.
Apr 12 06:30:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:46 user nova-compute[71711]: WARNING nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state active and task_state resize_migrating.
Apr 12 06:30:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:46 user nova-compute[71711]: WARNING nova.compute.manager [req-a3c70479-e098-48ad-a778-e0868670b6e2 req-11395848-455c-4f78-8059-6d8f243aea80 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state active and task_state resize_migrating.
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Port 8fba3fe8-62b6-46be-a025-3ec5a629ee80 binding to destination host user is already ACTIVE {{(pid=71711) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquired lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating instance_info_cache with network_info: [{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Releasing lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG os_brick.utils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3c1f39-7e5f-4650-8695-18c598f95260]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f7a808-6702-471e-8575-b986a799d61f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f13c475-e7de-4aea-83ae-849ea528cc8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7cce3c-9092-4b48-9d49-923399771fdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:30:48 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f484b2-e49b-4100-9078-f7194d059292]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG os_brick.utils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:30:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:30:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:49 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:30:49 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:30:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7809MB free_disk=26.288616180419922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:30:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Applying migration context for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 as it has an incoming, in-progress migration b40fbccb-d98f-4362-982f-4301471b7325. Migration status is post-migrating {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 06:30:50 user nova-compute[71711]: INFO nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating resource usage from migration b40fbccb-d98f-4362-982f-4301471b7325
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7dee97a4-9497-43c2-a688-7bedd1441885 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance d78558e6-437e-44dd-b6b4-123ed3447094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 35495bca-759b-4940-af0e-e6da34c73b34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 11dc4450-74e9-48ab-9de3-024baa6af9f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 3770a397-2124-4648-abad-d3ce6483e3b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Migration b40fbccb-d98f-4362-982f-4301471b7325 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:30:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:51 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:30:51 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:30:51 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:30:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:30:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:30:51 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:30:51 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:52 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updating instance_info_cache with network_info: [{"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:30:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-7dee97a4-9497-43c2-a688-7bedd1441885" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:30:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:30:52 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:30:52 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:30:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Starting finish_migration {{(pid=71711) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 06:30:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance directory exists: not creating {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 06:30:53 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Creating image(s)
Apr 12 06:30:53 user nova-compute[71711]: DEBUG nova.objects.instance [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:53 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:30:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Cannot resize image /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Ensure instance console log exists: /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Start _get_guest_xml network_info=[{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7c:bb:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5b5758b9-4f7e-4e85-8181-e3dfdd84e624', 'attached_at': '2023-04-12T06:30:54.000000', 'detached_at': '', 'volume_id': 'c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'serial': 'c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7'}, 'attachment_id': 'd2374a13-7899-49dc-8367-ba407e30a7ea', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:30:54 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:30:54 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.objects.instance [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:30:54 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:30:54 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:30:54 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4eff680-8cde-4810-92b4-a28c4d46da2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:30:54 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[53eaac1a-4ad6-4928-a6ff-be024df5398b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7] added
Apr 12 06:30:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a144cb02-00fc-4d19-bba8-714a6b524016]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[689372ef-b2a2-4ddf-8c59-76b09f829e9e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akKCItqp {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akKCItqp" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ae30b1-2967-4391-9783-47a29ffc489c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'akKCItqp'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[40019978-369b-4528-9231-c9a442106f1d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cbb702-4195-4b9b-9619-d4274ab28167]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:30:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:30:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa441f7b-2ba4-403d-9189-b02b44ad5859]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260]
Apr 12 06:30:54 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260] successful.
Apr 12 06:30:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eb1443-6e11-497d-8900-2ba2f30aae42]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d22e6da-41c4-411c-9b30-4bea72bbc8d5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:30:54 user nova-compute[71711]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:30:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:30:54 user nova-compute[71711]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:30:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3becff6d-331f-4eb4-a7c9-c6e416dfbd99]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:30:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26538346464396661', 'path': '/dev/sdc'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538346464396661', 'path': '/dev/sdc'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1807692588',display_name='tempest-ServerActionsTestJSON-server-1279128249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1807692588',id=4,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:26:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-hktvsdi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:30:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=5b5758b9-4f7e-4e85-8181-e3dfdd84e624,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7c:bb:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7c:bb:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:30:55 user nova-compute[71711]:   <uuid>5b5758b9-4f7e-4e85-8181-e3dfdd84e624</uuid>
Apr 12 06:30:55 user nova-compute[71711]:   <name>instance-00000004</name>
Apr 12 06:30:55 user nova-compute[71711]:   <memory>196608</memory>
Apr 12 06:30:55 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:30:55 user nova-compute[71711]:   <metadata>
Apr 12 06:30:55 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:30:55 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:30:55 user nova-compute[71711]:       <nova:name>tempest-ServerActionsTestJSON-server-1279128249</nova:name>
Apr 12 06:30:55 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:30:54</nova:creationTime>
Apr 12 06:30:55 user nova-compute[71711]:       <nova:flavor name="m1.micro">
Apr 12 06:30:55 user nova-compute[71711]:         <nova:memory>192</nova:memory>
Apr 12 06:30:55 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:30:55 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:30:55 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:30:55 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:30:55 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:30:55 user nova-compute[71711]:       <nova:owner>
Apr 12 06:30:55 user nova-compute[71711]:         <nova:user uuid="ad316acdc89947bbba60c75e9a24d7e9">tempest-ServerActionsTestJSON-752347644-project-member</nova:user>
Apr 12 06:30:55 user nova-compute[71711]:         <nova:project uuid="54fd87c4105246c1ac1bdf424c83b7aa">tempest-ServerActionsTestJSON-752347644</nova:project>
Apr 12 06:30:55 user nova-compute[71711]:       </nova:owner>
Apr 12 06:30:55 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:30:55 user nova-compute[71711]:       <nova:ports>
Apr 12 06:30:55 user nova-compute[71711]:         <nova:port uuid="8fba3fe8-62b6-46be-a025-3ec5a629ee80">
Apr 12 06:30:55 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 06:30:55 user nova-compute[71711]:         </nova:port>
Apr 12 06:30:55 user nova-compute[71711]:       </nova:ports>
Apr 12 06:30:55 user nova-compute[71711]:     </nova:instance>
Apr 12 06:30:55 user nova-compute[71711]:   </metadata>
Apr 12 06:30:55 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:30:55 user nova-compute[71711]:     <system>
Apr 12 06:30:55 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:30:55 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:30:55 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:30:55 user nova-compute[71711]:       <entry name="serial">5b5758b9-4f7e-4e85-8181-e3dfdd84e624</entry>
Apr 12 06:30:55 user nova-compute[71711]:       <entry name="uuid">5b5758b9-4f7e-4e85-8181-e3dfdd84e624</entry>
Apr 12 06:30:55 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:30:55 user nova-compute[71711]:     </system>
Apr 12 06:30:55 user nova-compute[71711]:   </sysinfo>
Apr 12 06:30:55 user nova-compute[71711]:   <os>
Apr 12 06:30:55 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:30:55 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:30:55 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:30:55 user nova-compute[71711]:   </os>
Apr 12 06:30:55 user nova-compute[71711]:   <features>
Apr 12 06:30:55 user nova-compute[71711]:     <acpi/>
Apr 12 06:30:55 user nova-compute[71711]:     <apic/>
Apr 12 06:30:55 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:30:55 user nova-compute[71711]:   </features>
Apr 12 06:30:55 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:30:55 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:30:55 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:30:55 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:30:55 user nova-compute[71711]:   </clock>
Apr 12 06:30:55 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:30:55 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:30:55 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:30:55 user nova-compute[71711]:   </cpu>
Apr 12 06:30:55 user nova-compute[71711]:   <devices>
Apr 12 06:30:55 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:30:55 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:30:55 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk"/>
Apr 12 06:30:55 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:30:55 user nova-compute[71711]:     </disk>
Apr 12 06:30:55 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:30:55 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:30:55 user nova-compute[71711]:       <source dev="/dev/sdc"/>
Apr 12 06:30:55 user nova-compute[71711]:       <target dev="vdb" bus="virtio"/>
Apr 12 06:30:55 user nova-compute[71711]:       <serial>c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7</serial>
Apr 12 06:30:55 user nova-compute[71711]:     </disk>
Apr 12 06:30:55 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:30:55 user nova-compute[71711]:       <mac address="fa:16:3e:7c:bb:4d"/>
Apr 12 06:30:55 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:30:55 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:30:55 user nova-compute[71711]:       <target dev="tap8fba3fe8-62"/>
Apr 12 06:30:55 user nova-compute[71711]:     </interface>
Apr 12 06:30:55 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:30:55 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/console.log" append="off"/>
Apr 12 06:30:55 user nova-compute[71711]:     </serial>
Apr 12 06:30:55 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:30:55 user nova-compute[71711]:     <video>
Apr 12 06:30:55 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:30:55 user nova-compute[71711]:     </video>
Apr 12 06:30:55 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:30:55 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:30:55 user nova-compute[71711]:     </rng>
Apr 12 06:30:55 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:30:55 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:30:55 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:30:55 user nova-compute[71711]:     </memballoon>
Apr 12 06:30:55 user nova-compute[71711]:   </devices>
Apr 12 06:30:55 user nova-compute[71711]: </domain>
Apr 12 06:30:55 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1807692588',display_name='tempest-ServerActionsTestJSON-server-1279128249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1807692588',id=4,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:26:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-hktvsdi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:30:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=5b5758b9-4f7e-4e85-8181-e3dfdd84e624,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7c:bb:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7c:bb:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG os_vif [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fba3fe8-62, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fba3fe8-62, col_values=(('external_ids', {'iface-id': '8fba3fe8-62b6-46be-a025-3ec5a629ee80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:bb:4d', 'vm-uuid': '5b5758b9-4f7e-4e85-8181-e3dfdd84e624'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:55 user nova-compute[71711]: INFO os_vif [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62')
Apr 12 06:30:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:30:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No VIF found with MAC fa:16:3e:7c:bb:4d, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:30:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:57 user nova-compute[71711]: DEBUG nova.compute.manager [req-3239f8f0-21f5-4d81-b409-813617361f66 req-49171dc9-ec9a-4fb1-86e6-d832a0ef336f service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3239f8f0-21f5-4d81-b409-813617361f66 req-49171dc9-ec9a-4fb1-86e6-d832a0ef336f service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3239f8f0-21f5-4d81-b409-813617361f66 req-49171dc9-ec9a-4fb1-86e6-d832a0ef336f service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3239f8f0-21f5-4d81-b409-813617361f66 req-49171dc9-ec9a-4fb1-86e6-d832a0ef336f service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:57 user nova-compute[71711]: DEBUG nova.compute.manager [req-3239f8f0-21f5-4d81-b409-813617361f66 req-49171dc9-ec9a-4fb1-86e6-d832a0ef336f service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:57 user nova-compute[71711]: WARNING nova.compute.manager [req-3239f8f0-21f5-4d81-b409-813617361f66 req-49171dc9-ec9a-4fb1-86e6-d832a0ef336f service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state active and task_state resize_finish.
Apr 12 06:30:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:30:58 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281058.8854725, 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:30:58 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] VM Resumed (Lifecycle Event)
Apr 12 06:30:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:30:58 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance running successfully.
Apr 12 06:30:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Failed to set time: agent not configured {{(pid=71711) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 06:30:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d6ca20d0-29c6-447b-8734-6b15b1924461 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] finish_migration finished successfully. {{(pid=71711) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 06:30:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:30:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:30:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:30:58 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 06:30:58 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281058.8903372, 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:30:58 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] VM Started (Lifecycle Event)
Apr 12 06:30:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:30:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:30:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 06:30:59 user nova-compute[71711]: DEBUG nova.compute.manager [req-80f50ebd-8b1f-4492-ac48-c514a6e0d119 req-a9655905-19e3-4a11-b859-7fda56f16154 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:30:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-80f50ebd-8b1f-4492-ac48-c514a6e0d119 req-a9655905-19e3-4a11-b859-7fda56f16154 service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:30:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-80f50ebd-8b1f-4492-ac48-c514a6e0d119 req-a9655905-19e3-4a11-b859-7fda56f16154 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:30:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-80f50ebd-8b1f-4492-ac48-c514a6e0d119 req-a9655905-19e3-4a11-b859-7fda56f16154 service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:30:59 user nova-compute[71711]: DEBUG nova.compute.manager [req-80f50ebd-8b1f-4492-ac48-c514a6e0d119 req-a9655905-19e3-4a11-b859-7fda56f16154 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:30:59 user nova-compute[71711]: WARNING nova.compute.manager [req-80f50ebd-8b1f-4492-ac48-c514a6e0d119 req-a9655905-19e3-4a11-b859-7fda56f16154 service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state resized and task_state None.
Apr 12 06:31:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "35495bca-759b-4940-af0e-e6da34c73b34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "35495bca-759b-4940-af0e-e6da34c73b34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "35495bca-759b-4940-af0e-e6da34c73b34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "35495bca-759b-4940-af0e-e6da34c73b34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "35495bca-759b-4940-af0e-e6da34c73b34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:01 user nova-compute[71711]: INFO nova.compute.manager [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Terminating instance
Apr 12 06:31:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:31:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-ed80531e-bfb3-46e3-98a0-dfd867da377f req-a6c83f0a-a1a0-47d2-bc06-176cd985e2d3 service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Received event network-vif-unplugged-c690dd1f-30e2-4a1b-983a-5089b2f351bd {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ed80531e-bfb3-46e3-98a0-dfd867da377f req-a6c83f0a-a1a0-47d2-bc06-176cd985e2d3 service nova] Acquiring lock "35495bca-759b-4940-af0e-e6da34c73b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ed80531e-bfb3-46e3-98a0-dfd867da377f req-a6c83f0a-a1a0-47d2-bc06-176cd985e2d3 service nova] Lock "35495bca-759b-4940-af0e-e6da34c73b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ed80531e-bfb3-46e3-98a0-dfd867da377f req-a6c83f0a-a1a0-47d2-bc06-176cd985e2d3 service nova] Lock "35495bca-759b-4940-af0e-e6da34c73b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-ed80531e-bfb3-46e3-98a0-dfd867da377f req-a6c83f0a-a1a0-47d2-bc06-176cd985e2d3 service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] No waiting events found dispatching network-vif-unplugged-c690dd1f-30e2-4a1b-983a-5089b2f351bd {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-ed80531e-bfb3-46e3-98a0-dfd867da377f req-a6c83f0a-a1a0-47d2-bc06-176cd985e2d3 service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Received event network-vif-unplugged-c690dd1f-30e2-4a1b-983a-5089b2f351bd for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:02 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Instance destroyed successfully.
Apr 12 06:31:02 user nova-compute[71711]: DEBUG nova.objects.instance [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lazy-loading 'resources' on Instance uuid 35495bca-759b-4940-af0e-e6da34c73b34 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1598595924',display_name='tempest-VolumesActionsTest-instance-1598595924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1598595924',id=19,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0a755743544f7c97644faad13bdeb4',ramdisk_id='',reservation_id='r-0dc00umq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1914558791',owner_user_name='tempest-VolumesActionsTest-1914558791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:29:17Z,user_data=None,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',uuid=35495bca-759b-4940-af0e-e6da34c73b34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "address": "fa:16:3e:92:7f:cc", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc690dd1f-30", "ovs_interfaceid": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Converting VIF {"id": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "address": "fa:16:3e:92:7f:cc", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc690dd1f-30", "ovs_interfaceid": "c690dd1f-30e2-4a1b-983a-5089b2f351bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:7f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c690dd1f-30e2-4a1b-983a-5089b2f351bd,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc690dd1f-30') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG os_vif [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:7f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c690dd1f-30e2-4a1b-983a-5089b2f351bd,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc690dd1f-30') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc690dd1f-30, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:02 user nova-compute[71711]: INFO os_vif [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:7f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c690dd1f-30e2-4a1b-983a-5089b2f351bd,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc690dd1f-30')
Apr 12 06:31:02 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Deleting instance files /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34_del
Apr 12 06:31:02 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Deletion of /opt/stack/data/nova/instances/35495bca-759b-4940-af0e-e6da34c73b34_del complete
Apr 12 06:31:02 user nova-compute[71711]: INFO nova.compute.manager [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Took 0.72 seconds to destroy the instance on the hypervisor.
Apr 12 06:31:02 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:31:02 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Took 0.49 seconds to deallocate network for instance.
Apr 12 06:31:02 user nova-compute[71711]: DEBUG nova.compute.manager [req-cb246310-1519-47e6-9276-0eae670c5717 req-2f0b7d6b-ad37-46b8-8aac-5cd0d27ef047 service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Received event network-vif-deleted-c690dd1f-30e2-4a1b-983a-5089b2f351bd {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:03 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:31:03 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:31:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:03 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Deleted allocations for instance 35495bca-759b-4940-af0e-e6da34c73b34
Apr 12 06:31:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2bc15ddd-c921-4977-a477-e6c2112e86d8 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "35495bca-759b-4940-af0e-e6da34c73b34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.746s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:03 user nova-compute[71711]: DEBUG nova.compute.manager [req-5426769e-eec0-4ee9-87c6-46df7d650469 req-f6bbd8bf-9284-4112-9b47-26cc1dcd9e0c service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Received event network-vif-plugged-c690dd1f-30e2-4a1b-983a-5089b2f351bd {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5426769e-eec0-4ee9-87c6-46df7d650469 req-f6bbd8bf-9284-4112-9b47-26cc1dcd9e0c service nova] Acquiring lock "35495bca-759b-4940-af0e-e6da34c73b34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5426769e-eec0-4ee9-87c6-46df7d650469 req-f6bbd8bf-9284-4112-9b47-26cc1dcd9e0c service nova] Lock "35495bca-759b-4940-af0e-e6da34c73b34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5426769e-eec0-4ee9-87c6-46df7d650469 req-f6bbd8bf-9284-4112-9b47-26cc1dcd9e0c service nova] Lock "35495bca-759b-4940-af0e-e6da34c73b34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:03 user nova-compute[71711]: DEBUG nova.compute.manager [req-5426769e-eec0-4ee9-87c6-46df7d650469 req-f6bbd8bf-9284-4112-9b47-26cc1dcd9e0c service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] No waiting events found dispatching network-vif-plugged-c690dd1f-30e2-4a1b-983a-5089b2f351bd {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:03 user nova-compute[71711]: WARNING nova.compute.manager [req-5426769e-eec0-4ee9-87c6-46df7d650469 req-f6bbd8bf-9284-4112-9b47-26cc1dcd9e0c service nova] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Received unexpected event network-vif-plugged-c690dd1f-30e2-4a1b-983a-5089b2f351bd for instance with vm_state deleted and task_state None.
Apr 12 06:31:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:12 user nova-compute[71711]: INFO nova.compute.manager [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Rescuing
Apr 12 06:31:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:31:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquired lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:31:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:31:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Updating instance_info_cache with network_info: [{"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:31:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Releasing lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:31:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3520cf7-2d11-4e8c-9964-dd075edbb225 req-b0997fe1-dcb5-4e79-ab93-151503ce81ff service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-unplugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3520cf7-2d11-4e8c-9964-dd075edbb225 req-b0997fe1-dcb5-4e79-ab93-151503ce81ff service nova] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3520cf7-2d11-4e8c-9964-dd075edbb225 req-b0997fe1-dcb5-4e79-ab93-151503ce81ff service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3520cf7-2d11-4e8c-9964-dd075edbb225 req-b0997fe1-dcb5-4e79-ab93-151503ce81ff service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3520cf7-2d11-4e8c-9964-dd075edbb225 req-b0997fe1-dcb5-4e79-ab93-151503ce81ff service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] No waiting events found dispatching network-vif-unplugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:13 user nova-compute[71711]: WARNING nova.compute.manager [req-e3520cf7-2d11-4e8c-9964-dd075edbb225 req-b0997fe1-dcb5-4e79-ab93-151503ce81ff service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received unexpected event network-vif-unplugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance with vm_state active and task_state rescuing.
Apr 12 06:31:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:13 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Instance destroyed successfully.
Apr 12 06:31:13 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Attempting a stable device rescue
Apr 12 06:31:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71711) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Instance directory exists: not creating {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 06:31:13 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Creating image(s)
Apr 12 06:31:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "/opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "/opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG nova.objects.instance [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'trusted_certs' on Instance uuid ebb36f74-c4a3-4108-949d-1fb8918f9a8c {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "dfef1d88e4ef365d8235901be71f69a220720118" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "dfef1d88e4ef365d8235901be71f69a220720118" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118.part --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118.part --force-share --output=json" returned: 0 in 0.145s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.images [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 838e110f-042b-4725-8084-993da3d9f384 was qcow2, converting to raw {{(pid=71711) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118.part /opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118.converted {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118.part /opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118.converted" returned: 0 in 0.236s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118.converted --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118.converted --force-share --output=json" returned: 0 in 0.163s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "dfef1d88e4ef365d8235901be71f69a220720118" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.124s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "dfef1d88e4ef365d8235901be71f69a220720118" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "dfef1d88e4ef365d8235901be71f69a220720118" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118 --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118,backing_fmt=raw /opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.rescue {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118,backing_fmt=raw /opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.rescue" returned: 0 in 0.052s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "dfef1d88e4ef365d8235901be71f69a220720118" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.objects.instance [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'migration_context' on Instance uuid ebb36f74-c4a3-4108-949d-1fb8918f9a8c {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Start _get_guest_xml network_info=[{"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "vif_mac": "fa:16:3e:33:83:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '838e110f-042b-4725-8084-993da3d9f384', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQizkfug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ebb36f74-c4a3-4108-949d-1fb8918f9a8c', 'attached_at': '', 'detached_at': '', 'volume_id': '9013e447-dbe0-46fc-97fe-c8d65768b297', 'serial': '9013e447-dbe0-46fc-97fe-c8d65768b297'}, 'attachment_id': '86dae585-faec-4479-90d5-f67160f21e09', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.objects.instance [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'resources' on Instance uuid ebb36f74-c4a3-4108-949d-1fb8918f9a8c {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.objects.instance [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'numa_topology' on Instance uuid ebb36f74-c4a3-4108-949d-1fb8918f9a8c {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:31:14 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:31:14 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.objects.instance [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'vcpu_model' on Instance uuid ebb36f74-c4a3-4108-949d-1fb8918f9a8c {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQizkfug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:31:14 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:31:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:31:14 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:31:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:31:14 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb3bcb0-af50-447b-9f2c-2ed941003140]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KQizkfug\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 06:31:14 user nova-compute[71711]: node.name = iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:31:14 user nova-compute[71711]: node.tpgt = -1
Apr 12 06:31:14 user nova-compute[71711]: node.startup = automatic
Apr 12 06:31:14 user nova-compute[71711]: node.leading_login = No
Apr 12 06:31:14 user nova-compute[71711]: iface.iscsi_ifacename = default
Apr 12 06:31:14 user nova-compute[71711]: iface.net_ifacename = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.ipaddress = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.prefix_len = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.hwaddress = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.transport_name = tcp
Apr 12 06:31:14 user nova-compute[71711]: iface.initiatorname = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.state = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.vlan_id = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.vlan_priority = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.vlan_state = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.iface_num = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.mtu = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.port = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.bootproto = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.subnet_mask = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.gateway = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.dhcp_alt_client_id = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.dhcp_dns = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.dhcp_learn_iqn = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.dhcp_vendor_id_state = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.dhcp_vendor_id = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.dhcp_slp_da = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.fragmentation = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.gratuitous_arp = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.incoming_forwarding = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.tos_state = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.tos = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.ttl = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.delayed_ack = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.tcp_nagle = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.tcp_wsf_state = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.tcp_wsf = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.tcp_timer_scale = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.tcp_timestamp = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.redirect = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.def_task_mgmt_timeout = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.header_digest = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.data_digest = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.immediate_data = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.initial_r2t = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.data_seq_inorder = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.data_pdu_inorder = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.erl = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.max_receive_data_len = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.first_burst_len = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.max_outstanding_r2t = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.max_burst_len = 0
Apr 12 06:31:14 user nova-compute[71711]: iface.chap_auth = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.bidi_chap = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.strict_login_compliance = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.discovery_auth = <empty>
Apr 12 06:31:14 user nova-compute[71711]: iface.discovery_logout = <empty>
Apr 12 06:31:14 user nova-compute[71711]: node.discovery_address = <empty>
Apr 12 06:31:14 user nova-compute[71711]: node.discovery_port = 0
Apr 12 06:31:14 user nova-compute[71711]: node.discovery_type = static
Apr 12 06:31:14 user nova-compute[71711]: node.session.initial_cmdsn = 0
Apr 12 06:31:14 user nova-compute[71711]: node.session.initial_login_retry_max = 8
Apr 12 06:31:14 user nova-compute[71711]: node.session.xmit_thread_priority = -20
Apr 12 06:31:14 user nova-compute[71711]: node.session.cmds_max = 128
Apr 12 06:31:14 user nova-compute[71711]: node.session.queue_depth = 32
Apr 12 06:31:14 user nova-compute[71711]: node.session.nr_sessions = 1
Apr 12 06:31:14 user nova-compute[71711]: node.session.auth.authmethod = CHAP
Apr 12 06:31:14 user nova-compute[71711]: node.session.auth.username = KQizkfug
Apr 12 06:31:14 user nova-compute[71711]: node.session.auth.password = ***
Apr 12 06:31:14 user nova-compute[71711]: node.session.auth.username_in = <empty>
Apr 12 06:31:14 user nova-compute[71711]: node.session.auth.password_in = <empty>
Apr 12 06:31:14 user nova-compute[71711]: node.session.auth.chap_algs = MD5
Apr 12 06:31:14 user nova-compute[71711]: node.session.timeo.replacement_timeout = 120
Apr 12 06:31:14 user nova-compute[71711]: node.session.err_timeo.abort_timeout = 15
Apr 12 06:31:14 user nova-compute[71711]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 06:31:14 user nova-compute[71711]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 06:31:14 user nova-compute[71711]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 06:31:14 user nova-compute[71711]: node.session.iscsi.FastAbort = Yes
Apr 12 06:31:14 user nova-compute[71711]: node.session.iscsi.InitialR2T = No
Apr 12 06:31:14 user nova-compute[71711]: node.session.iscsi.ImmediateData = Yes
Apr 12 06:31:14 user nova-compute[71711]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 06:31:14 user nova-compute[71711]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 06:31:14 user nova-compute[71711]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 06:31:14 user nova-compute[71711]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 06:31:14 user nova-compute[71711]: node.session.iscsi.MaxConnections = 1
Apr 12 06:31:14 user nova-compute[71711]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 06:31:14 user nova-compute[71711]: node.session.iscsi.ERL = 0
Apr 12 06:31:14 user nova-compute[71711]: node.session.scan = manual
Apr 12 06:31:14 user nova-compute[71711]: node.session.reopen_max = 0
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].address = 172.16.0.220
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].port = 3260
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].startup = manual
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].tcp.window_size = 524288
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].tcp.type_of_service = 0
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].timeo.logout_timeout = 15
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].timeo.login_timeout = 15
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].timeo.auth_timeout = 45
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].iscsi.DataDigest = None
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].iscsi.IFMarker = No
Apr 12 06:31:14 user nova-compute[71711]: node.conn[0].iscsi.OFMarker = No
Apr 12 06:31:14 user nova-compute[71711]: # END RECORD
Apr 12 06:31:14 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:31:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ed940c-1fb8-4d6e-9bbd-d8d5444dafce]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebdbb31-f453-40ce-ad8c-92d991896f44]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KQizkfug {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KQizkfug" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[241cb6a2-aca4-400e-955c-80ca30600aaa]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KQizkfug'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-9e68e808-010f-45e2-a889-b7237adf5226 req-f3063346-a3ab-4be2-b90a-a211e4404bf0 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9e68e808-010f-45e2-a889-b7237adf5226 req-f3063346-a3ab-4be2-b90a-a211e4404bf0 service nova] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9e68e808-010f-45e2-a889-b7237adf5226 req-f3063346-a3ab-4be2-b90a-a211e4404bf0 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9e68e808-010f-45e2-a889-b7237adf5226 req-f3063346-a3ab-4be2-b90a-a211e4404bf0 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-9e68e808-010f-45e2-a889-b7237adf5226 req-f3063346-a3ab-4be2-b90a-a211e4404bf0 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] No waiting events found dispatching network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:15 user nova-compute[71711]: WARNING nova.compute.manager [req-9e68e808-010f-45e2-a889-b7237adf5226 req-f3063346-a3ab-4be2-b90a-a211e4404bf0 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received unexpected event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance with vm_state active and task_state rescuing.
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3051b8ec-8356-4c7c-9dfb-06d7479971e5]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd18518-b33b-42a0-b1b3-bd97d9fb4f8b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:31:15 user nova-compute[71711]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:31:15 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:31:15 user nova-compute[71711]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:31:15 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.164s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] HCTL ('33', '0', '0', 0) found on session 23 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b70e87b-5fa2-45b8-a19a-bd4ece6885e0]: (4, ('0 0 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Searching for a device in session 23 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQizkfug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.189s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] <== connect_volume: return (191ms) {'type': 'block', 'scsi_wwn': '23838393638393066', 'path': '/dev/sdb'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838393638393066', 'path': '/dev/sdb'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:29:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2071604680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2071604680',id=20,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:29:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-8q0yisgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:29:37Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=ebb36f74-c4a3-4108-949d-1fb8918f9a8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "vif_mac": "fa:16:3e:33:83:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "vif_mac": "fa:16:3e:33:83:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=0beef467-c01f-4521-8d4a-85c0f1f7dd1f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beef467-c0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG nova.objects.instance [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'pci_devices' on Instance uuid ebb36f74-c4a3-4108-949d-1fb8918f9a8c {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:31:15 user nova-compute[71711]:   <uuid>ebb36f74-c4a3-4108-949d-1fb8918f9a8c</uuid>
Apr 12 06:31:15 user nova-compute[71711]:   <name>instance-00000014</name>
Apr 12 06:31:15 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:31:15 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:31:15 user nova-compute[71711]:   <metadata>
Apr 12 06:31:15 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:31:15 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:31:15 user nova-compute[71711]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2071604680</nova:name>
Apr 12 06:31:15 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:31:14</nova:creationTime>
Apr 12 06:31:15 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:31:15 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:31:15 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:31:15 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:31:15 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:31:15 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:31:15 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:31:15 user nova-compute[71711]:       <nova:owner>
Apr 12 06:31:15 user nova-compute[71711]:         <nova:user uuid="2e5e4455358643b8830ce8c96aad5aad">tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member</nova:user>
Apr 12 06:31:15 user nova-compute[71711]:         <nova:project uuid="0ecae91e53ee4d70a8dc24c7febc2a0e">tempest-ServerBootFromVolumeStableRescueTest-2063268056</nova:project>
Apr 12 06:31:15 user nova-compute[71711]:       </nova:owner>
Apr 12 06:31:15 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:31:15 user nova-compute[71711]:       <nova:ports>
Apr 12 06:31:15 user nova-compute[71711]:         <nova:port uuid="0beef467-c01f-4521-8d4a-85c0f1f7dd1f">
Apr 12 06:31:15 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 06:31:15 user nova-compute[71711]:         </nova:port>
Apr 12 06:31:15 user nova-compute[71711]:       </nova:ports>
Apr 12 06:31:15 user nova-compute[71711]:     </nova:instance>
Apr 12 06:31:15 user nova-compute[71711]:   </metadata>
Apr 12 06:31:15 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:31:15 user nova-compute[71711]:     <system>
Apr 12 06:31:15 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:31:15 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:31:15 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:31:15 user nova-compute[71711]:       <entry name="serial">ebb36f74-c4a3-4108-949d-1fb8918f9a8c</entry>
Apr 12 06:31:15 user nova-compute[71711]:       <entry name="uuid">ebb36f74-c4a3-4108-949d-1fb8918f9a8c</entry>
Apr 12 06:31:15 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:31:15 user nova-compute[71711]:     </system>
Apr 12 06:31:15 user nova-compute[71711]:   </sysinfo>
Apr 12 06:31:15 user nova-compute[71711]:   <os>
Apr 12 06:31:15 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:31:15 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:31:15 user nova-compute[71711]:   </os>
Apr 12 06:31:15 user nova-compute[71711]:   <features>
Apr 12 06:31:15 user nova-compute[71711]:     <acpi/>
Apr 12 06:31:15 user nova-compute[71711]:     <apic/>
Apr 12 06:31:15 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:31:15 user nova-compute[71711]:   </features>
Apr 12 06:31:15 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:31:15 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:31:15 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:31:15 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:31:15 user nova-compute[71711]:   </clock>
Apr 12 06:31:15 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:31:15 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:31:15 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:31:15 user nova-compute[71711]:   </cpu>
Apr 12 06:31:15 user nova-compute[71711]:   <devices>
Apr 12 06:31:15 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:31:15 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:31:15 user nova-compute[71711]:       <source dev="/dev/sdb"/>
Apr 12 06:31:15 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:31:15 user nova-compute[71711]:       <serial>9013e447-dbe0-46fc-97fe-c8d65768b297</serial>
Apr 12 06:31:15 user nova-compute[71711]:     </disk>
Apr 12 06:31:15 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:31:15 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:31:15 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.rescue"/>
Apr 12 06:31:15 user nova-compute[71711]:       <target dev="vdb" bus="virtio"/>
Apr 12 06:31:15 user nova-compute[71711]:       <boot order="1"/>
Apr 12 06:31:15 user nova-compute[71711]:     </disk>
Apr 12 06:31:15 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:31:15 user nova-compute[71711]:       <mac address="fa:16:3e:33:83:aa"/>
Apr 12 06:31:15 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:31:15 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:31:15 user nova-compute[71711]:       <target dev="tap0beef467-c0"/>
Apr 12 06:31:15 user nova-compute[71711]:     </interface>
Apr 12 06:31:15 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:31:15 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/console.log" append="off"/>
Apr 12 06:31:15 user nova-compute[71711]:     </serial>
Apr 12 06:31:15 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:31:15 user nova-compute[71711]:     <video>
Apr 12 06:31:15 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:31:15 user nova-compute[71711]:     </video>
Apr 12 06:31:15 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:31:15 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:31:15 user nova-compute[71711]:     </rng>
Apr 12 06:31:15 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:31:15 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:31:15 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:31:15 user nova-compute[71711]:     </memballoon>
Apr 12 06:31:15 user nova-compute[71711]:   </devices>
Apr 12 06:31:15 user nova-compute[71711]: </domain>
Apr 12 06:31:15 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:31:15 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Instance destroyed successfully.
Apr 12 06:31:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No VIF found with MAC fa:16:3e:33:83:aa, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:15 user nova-compute[71711]: INFO nova.compute.manager [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Terminating instance
Apr 12 06:31:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:16 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Instance destroyed successfully.
Apr 12 06:31:16 user nova-compute[71711]: DEBUG nova.objects.instance [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'resources' on Instance uuid 7dee97a4-9497-43c2-a688-7bedd1441885 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-347561886',display_name='tempest-AttachVolumeTestJSON-server-347561886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-347561886',id=2,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwrNegtuUQxlGPyN3pFJ5X6ve+WFpWa8ZN5z88plFcMC7jAP25D92PakJ6yQbAkk2nQ1OF8Me+pJecej1aLutIgKjYku+yi3zY9Z7mDtSHYPVUZwc5/VPOAX8HIWorUMg==',key_name='tempest-keypair-673948167',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:21:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f124d62c4d345d9af22f1557abca276',ramdisk_id='',reservation_id='r-l92zv936',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1680327736',owner_user_name='tempest-AttachVolumeTestJSON-1680327736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:29:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d58cc232d0094bebacf147c6b61a0989',uuid=7dee97a4-9497-43c2-a688-7bedd1441885,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converting VIF {"id": "1e69d862-c01c-48c7-8795-00233f9e7812", "address": "fa:16:3e:4c:89:31", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e69d862-c0", "ovs_interfaceid": "1e69d862-c01c-48c7-8795-00233f9e7812", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG os_vif [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e69d862-c0, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:16 user nova-compute[71711]: INFO os_vif [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:89:31,bridge_name='br-int',has_traffic_filtering=True,id=1e69d862-c01c-48c7-8795-00233f9e7812,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e69d862-c0')
Apr 12 06:31:16 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Deleting instance files /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885_del
Apr 12 06:31:16 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Deletion of /opt/stack/data/nova/instances/7dee97a4-9497-43c2-a688-7bedd1441885_del complete
Apr 12 06:31:16 user nova-compute[71711]: INFO nova.compute.manager [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 12 06:31:16 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-unplugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] No waiting events found dispatching network-vif-unplugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-unplugged-1e69d862-c01c-48c7-8795-00233f9e7812 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] Acquiring lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] Lock "7dee97a4-9497-43c2-a688-7bedd1441885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] No waiting events found dispatching network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:17 user nova-compute[71711]: WARNING nova.compute.manager [req-610e100e-dd4b-40ae-a348-332c7e88d60d req-4dc958ad-de43-464a-bc66-cae9630f0b27 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received unexpected event network-vif-plugged-1e69d862-c01c-48c7-8795-00233f9e7812 for instance with vm_state active and task_state deleting.
Apr 12 06:31:17 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281062.2300622, 35495bca-759b-4940-af0e-e6da34c73b34 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:31:17 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] VM Stopped (Lifecycle Event)
Apr 12 06:31:17 user nova-compute[71711]: DEBUG nova.compute.manager [None req-50f49a98-2bf0-4bf7-89aa-c9f3e268c3d2 None None] [instance: 35495bca-759b-4940-af0e-e6da34c73b34] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee9ec9ae-06e2-4cee-b07f-cd590a850e6a req-082c78a6-0d0d-4d2e-aa33-208091ef4da0 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Received event network-vif-deleted-1e69d862-c01c-48c7-8795-00233f9e7812 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:17 user nova-compute[71711]: INFO nova.compute.manager [req-ee9ec9ae-06e2-4cee-b07f-cd590a850e6a req-082c78a6-0d0d-4d2e-aa33-208091ef4da0 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Neutron deleted interface 1e69d862-c01c-48c7-8795-00233f9e7812; detaching it from the instance and deleting it from the info cache
Apr 12 06:31:17 user nova-compute[71711]: DEBUG nova.network.neutron [req-ee9ec9ae-06e2-4cee-b07f-cd590a850e6a req-082c78a6-0d0d-4d2e-aa33-208091ef4da0 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:31:17 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Took 0.77 seconds to deallocate network for instance.
Apr 12 06:31:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee9ec9ae-06e2-4cee-b07f-cd590a850e6a req-082c78a6-0d0d-4d2e-aa33-208091ef4da0 service nova] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Detach interface failed, port_id=1e69d862-c01c-48c7-8795-00233f9e7812, reason: Instance 7dee97a4-9497-43c2-a688-7bedd1441885 could not be found. {{(pid=71711) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:31:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:17 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Deleted allocations for instance 7dee97a4-9497-43c2-a688-7bedd1441885
Apr 12 06:31:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8058b718-3c45-4f6e-b050-6e55db100d0f tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7dee97a4-9497-43c2-a688-7bedd1441885" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.289s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for ebb36f74-c4a3-4108-949d-1fb8918f9a8c due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281079.0331695, ebb36f74-c4a3-4108-949d-1fb8918f9a8c => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:31:19 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] VM Resumed (Lifecycle Event)
Apr 12 06:31:19 user nova-compute[71711]: DEBUG nova.compute.manager [None req-af3571d3-61b3-43f7-8e87-6151f7e17d27 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:31:19 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 06:31:19 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281079.0342674, ebb36f74-c4a3-4108-949d-1fb8918f9a8c => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:31:19 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] VM Started (Lifecycle Event)
Apr 12 06:31:19 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] No waiting events found dispatching network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:19 user nova-compute[71711]: WARNING nova.compute.manager [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received unexpected event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance with vm_state rescued and task_state None.
Apr 12 06:31:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] No waiting events found dispatching network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:19 user nova-compute[71711]: WARNING nova.compute.manager [req-a14987c2-b8b6-4c15-b00f-897ba7024fbd req-3f810d18-5125-4602-8c3b-f3c47204d3b4 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received unexpected event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance with vm_state rescued and task_state None.
Apr 12 06:31:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:31:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:31:22 user nova-compute[71711]: INFO nova.compute.claims [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Claim successful on node user
Apr 12 06:31:22 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:31:22 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:31:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG nova.network.neutron [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:31:23 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:31:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG nova.policy [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:31:23 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Creating image(s)
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "/opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "/opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.149s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.144s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk 1073741824" returned: 0 in 0.062s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.147s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Cannot resize image /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:31:23 user nova-compute[71711]: DEBUG nova.objects.instance [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'migration_context' on Instance uuid cb572c1a-2901-4b09-920d-e3e0da7765b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:31:24 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:31:24 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Ensure instance console log exists: /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:31:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:24 user nova-compute[71711]: DEBUG nova.network.neutron [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Successfully created port: d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.network.neutron [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Successfully updated port: d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "refresh_cache-cb572c1a-2901-4b09-920d-e3e0da7765b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquired lock "refresh_cache-cb572c1a-2901-4b09-920d-e3e0da7765b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.network.neutron [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Received event network-changed-d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Refreshing instance network info cache due to event network-changed-d754ac1a-af83-49a7-8476-727172ee88b1. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] Acquiring lock "refresh_cache-cb572c1a-2901-4b09-920d-e3e0da7765b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.network.neutron [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.network.neutron [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Updating instance_info_cache with network_info: [{"id": "d754ac1a-af83-49a7-8476-727172ee88b1", "address": "fa:16:3e:94:49:68", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd754ac1a-af", "ovs_interfaceid": "d754ac1a-af83-49a7-8476-727172ee88b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Releasing lock "refresh_cache-cb572c1a-2901-4b09-920d-e3e0da7765b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.compute.manager [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Instance network_info: |[{"id": "d754ac1a-af83-49a7-8476-727172ee88b1", "address": "fa:16:3e:94:49:68", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd754ac1a-af", "ovs_interfaceid": "d754ac1a-af83-49a7-8476-727172ee88b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] Acquired lock "refresh_cache-cb572c1a-2901-4b09-920d-e3e0da7765b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.network.neutron [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Refreshing network info cache for port d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Start _get_guest_xml network_info=[{"id": "d754ac1a-af83-49a7-8476-727172ee88b1", "address": "fa:16:3e:94:49:68", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd754ac1a-af", "ovs_interfaceid": "d754ac1a-af83-49a7-8476-727172ee88b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:31:25 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:31:25 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2019489998',display_name='tempest-AttachVolumeNegativeTest-server-2019489998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2019489998',id=23,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLjxQ88AtZRhXkY0w8AIQaC2BkRU10aHemy0vGFQIJaHfdQnFw5jX788hQrmmL2cfXBPzOBR1uFgPc7i6axEKrPM67paZDd875f3qCLLPV1vMiFyxrryrbMz1BF5WwCng==',key_name='tempest-keypair-2104449008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b267dce1303d451ca307eeaa38baf685',ramdisk_id='',reservation_id='r-0fit5mx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1905486920',owner_user_name='tempest-AttachVolumeNegativeTest-1905486920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:31:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',uuid=cb572c1a-2901-4b09-920d-e3e0da7765b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d754ac1a-af83-49a7-8476-727172ee88b1", "address": "fa:16:3e:94:49:68", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd754ac1a-af", "ovs_interfaceid": "d754ac1a-af83-49a7-8476-727172ee88b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converting VIF {"id": "d754ac1a-af83-49a7-8476-727172ee88b1", "address": "fa:16:3e:94:49:68", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd754ac1a-af", "ovs_interfaceid": "d754ac1a-af83-49a7-8476-727172ee88b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:49:68,bridge_name='br-int',has_traffic_filtering=True,id=d754ac1a-af83-49a7-8476-727172ee88b1,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd754ac1a-af') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.objects.instance [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'pci_devices' on Instance uuid cb572c1a-2901-4b09-920d-e3e0da7765b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:31:25 user nova-compute[71711]:   <uuid>cb572c1a-2901-4b09-920d-e3e0da7765b2</uuid>
Apr 12 06:31:25 user nova-compute[71711]:   <name>instance-00000017</name>
Apr 12 06:31:25 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:31:25 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:31:25 user nova-compute[71711]:   <metadata>
Apr 12 06:31:25 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:31:25 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:31:25 user nova-compute[71711]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2019489998</nova:name>
Apr 12 06:31:25 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:31:25</nova:creationTime>
Apr 12 06:31:25 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:31:25 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:31:25 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:31:25 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:31:25 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:31:25 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:31:25 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:31:25 user nova-compute[71711]:       <nova:owner>
Apr 12 06:31:25 user nova-compute[71711]:         <nova:user uuid="d6cd1f8b3c0d42298f6f4a303f1251ec">tempest-AttachVolumeNegativeTest-1905486920-project-member</nova:user>
Apr 12 06:31:25 user nova-compute[71711]:         <nova:project uuid="b267dce1303d451ca307eeaa38baf685">tempest-AttachVolumeNegativeTest-1905486920</nova:project>
Apr 12 06:31:25 user nova-compute[71711]:       </nova:owner>
Apr 12 06:31:25 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:31:25 user nova-compute[71711]:       <nova:ports>
Apr 12 06:31:25 user nova-compute[71711]:         <nova:port uuid="d754ac1a-af83-49a7-8476-727172ee88b1">
Apr 12 06:31:25 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 06:31:25 user nova-compute[71711]:         </nova:port>
Apr 12 06:31:25 user nova-compute[71711]:       </nova:ports>
Apr 12 06:31:25 user nova-compute[71711]:     </nova:instance>
Apr 12 06:31:25 user nova-compute[71711]:   </metadata>
Apr 12 06:31:25 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:31:25 user nova-compute[71711]:     <system>
Apr 12 06:31:25 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:31:25 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:31:25 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:31:25 user nova-compute[71711]:       <entry name="serial">cb572c1a-2901-4b09-920d-e3e0da7765b2</entry>
Apr 12 06:31:25 user nova-compute[71711]:       <entry name="uuid">cb572c1a-2901-4b09-920d-e3e0da7765b2</entry>
Apr 12 06:31:25 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:31:25 user nova-compute[71711]:     </system>
Apr 12 06:31:25 user nova-compute[71711]:   </sysinfo>
Apr 12 06:31:25 user nova-compute[71711]:   <os>
Apr 12 06:31:25 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:31:25 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:31:25 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:31:25 user nova-compute[71711]:   </os>
Apr 12 06:31:25 user nova-compute[71711]:   <features>
Apr 12 06:31:25 user nova-compute[71711]:     <acpi/>
Apr 12 06:31:25 user nova-compute[71711]:     <apic/>
Apr 12 06:31:25 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:31:25 user nova-compute[71711]:   </features>
Apr 12 06:31:25 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:31:25 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:31:25 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:31:25 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:31:25 user nova-compute[71711]:   </clock>
Apr 12 06:31:25 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:31:25 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:31:25 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:31:25 user nova-compute[71711]:   </cpu>
Apr 12 06:31:25 user nova-compute[71711]:   <devices>
Apr 12 06:31:25 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:31:25 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:31:25 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk"/>
Apr 12 06:31:25 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:31:25 user nova-compute[71711]:     </disk>
Apr 12 06:31:25 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:31:25 user nova-compute[71711]:       <mac address="fa:16:3e:94:49:68"/>
Apr 12 06:31:25 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:31:25 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:31:25 user nova-compute[71711]:       <target dev="tapd754ac1a-af"/>
Apr 12 06:31:25 user nova-compute[71711]:     </interface>
Apr 12 06:31:25 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:31:25 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/console.log" append="off"/>
Apr 12 06:31:25 user nova-compute[71711]:     </serial>
Apr 12 06:31:25 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:31:25 user nova-compute[71711]:     <video>
Apr 12 06:31:25 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:31:25 user nova-compute[71711]:     </video>
Apr 12 06:31:25 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:31:25 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:31:25 user nova-compute[71711]:     </rng>
Apr 12 06:31:25 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:31:25 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:31:25 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:31:25 user nova-compute[71711]:     </memballoon>
Apr 12 06:31:25 user nova-compute[71711]:   </devices>
Apr 12 06:31:25 user nova-compute[71711]: </domain>
Apr 12 06:31:25 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2019489998',display_name='tempest-AttachVolumeNegativeTest-server-2019489998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2019489998',id=23,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLjxQ88AtZRhXkY0w8AIQaC2BkRU10aHemy0vGFQIJaHfdQnFw5jX788hQrmmL2cfXBPzOBR1uFgPc7i6axEKrPM67paZDd875f3qCLLPV1vMiFyxrryrbMz1BF5WwCng==',key_name='tempest-keypair-2104449008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b267dce1303d451ca307eeaa38baf685',ramdisk_id='',reservation_id='r-0fit5mx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1905486920',owner_user_name='tempest-AttachVolumeNegativeTest-1905486920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:31:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',uuid=cb572c1a-2901-4b09-920d-e3e0da7765b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d754ac1a-af83-49a7-8476-727172ee88b1", "address": "fa:16:3e:94:49:68", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd754ac1a-af", "ovs_interfaceid": "d754ac1a-af83-49a7-8476-727172ee88b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converting VIF {"id": "d754ac1a-af83-49a7-8476-727172ee88b1", "address": "fa:16:3e:94:49:68", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd754ac1a-af", "ovs_interfaceid": "d754ac1a-af83-49a7-8476-727172ee88b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:49:68,bridge_name='br-int',has_traffic_filtering=True,id=d754ac1a-af83-49a7-8476-727172ee88b1,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd754ac1a-af') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG os_vif [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:49:68,bridge_name='br-int',has_traffic_filtering=True,id=d754ac1a-af83-49a7-8476-727172ee88b1,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd754ac1a-af') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd754ac1a-af, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd754ac1a-af, col_values=(('external_ids', {'iface-id': 'd754ac1a-af83-49a7-8476-727172ee88b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:49:68', 'vm-uuid': 'cb572c1a-2901-4b09-920d-e3e0da7765b2'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:25 user nova-compute[71711]: INFO os_vif [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:49:68,bridge_name='br-int',has_traffic_filtering=True,id=d754ac1a-af83-49a7-8476-727172ee88b1,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd754ac1a-af')
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:31:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No VIF found with MAC fa:16:3e:94:49:68, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:31:26 user nova-compute[71711]: DEBUG nova.network.neutron [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Updated VIF entry in instance network info cache for port d754ac1a-af83-49a7-8476-727172ee88b1. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:31:26 user nova-compute[71711]: DEBUG nova.network.neutron [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Updating instance_info_cache with network_info: [{"id": "d754ac1a-af83-49a7-8476-727172ee88b1", "address": "fa:16:3e:94:49:68", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd754ac1a-af", "ovs_interfaceid": "d754ac1a-af83-49a7-8476-727172ee88b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:31:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d1b3693c-1752-41dd-add7-3e65891d8cd3 req-c9af2344-ca1b-42e4-bce0-9f90ec3f6f77 service nova] Releasing lock "refresh_cache-cb572c1a-2901-4b09-920d-e3e0da7765b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:31:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-e884d06a-1ddc-4b00-881b-9bb08e530254 req-be86b839-e2c2-44b4-aa21-425c3e28794f service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Received event network-vif-plugged-d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e884d06a-1ddc-4b00-881b-9bb08e530254 req-be86b839-e2c2-44b4-aa21-425c3e28794f service nova] Acquiring lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e884d06a-1ddc-4b00-881b-9bb08e530254 req-be86b839-e2c2-44b4-aa21-425c3e28794f service nova] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e884d06a-1ddc-4b00-881b-9bb08e530254 req-be86b839-e2c2-44b4-aa21-425c3e28794f service nova] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-e884d06a-1ddc-4b00-881b-9bb08e530254 req-be86b839-e2c2-44b4-aa21-425c3e28794f service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] No waiting events found dispatching network-vif-plugged-d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:27 user nova-compute[71711]: WARNING nova.compute.manager [req-e884d06a-1ddc-4b00-881b-9bb08e530254 req-be86b839-e2c2-44b4-aa21-425c3e28794f service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Received unexpected event network-vif-plugged-d754ac1a-af83-49a7-8476-727172ee88b1 for instance with vm_state building and task_state spawning.
Apr 12 06:31:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281089.2948685, cb572c1a-2901-4b09-920d-e3e0da7765b2 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:31:29 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] VM Resumed (Lifecycle Event)
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:31:29 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Instance spawned successfully.
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:31:29 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281089.296169, cb572c1a-2901-4b09-920d-e3e0da7765b2 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:31:29 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] VM Started (Lifecycle Event)
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:31:29 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:31:29 user nova-compute[71711]: INFO nova.compute.manager [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Took 6.18 seconds to spawn the instance on the hypervisor.
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-77452408-17d4-43ee-ac9b-7a51bde581ef req-b44078dd-49ad-4282-b357-b9f2dd2ba75c service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Received event network-vif-plugged-d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-77452408-17d4-43ee-ac9b-7a51bde581ef req-b44078dd-49ad-4282-b357-b9f2dd2ba75c service nova] Acquiring lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-77452408-17d4-43ee-ac9b-7a51bde581ef req-b44078dd-49ad-4282-b357-b9f2dd2ba75c service nova] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-77452408-17d4-43ee-ac9b-7a51bde581ef req-b44078dd-49ad-4282-b357-b9f2dd2ba75c service nova] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-77452408-17d4-43ee-ac9b-7a51bde581ef req-b44078dd-49ad-4282-b357-b9f2dd2ba75c service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] No waiting events found dispatching network-vif-plugged-d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:29 user nova-compute[71711]: WARNING nova.compute.manager [req-77452408-17d4-43ee-ac9b-7a51bde581ef req-b44078dd-49ad-4282-b357-b9f2dd2ba75c service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Received unexpected event network-vif-plugged-d754ac1a-af83-49a7-8476-727172ee88b1 for instance with vm_state building and task_state spawning.
Apr 12 06:31:29 user nova-compute[71711]: INFO nova.compute.manager [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Took 7.02 seconds to build instance.
Apr 12 06:31:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-014ce3da-c681-442d-b338-9ad04e028415 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.109s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:31 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281076.506902, 7dee97a4-9497-43c2-a688-7bedd1441885 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:31:31 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] VM Stopped (Lifecycle Event)
Apr 12 06:31:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-c2c2a0dc-0141-49ce-8726-e5c09b8982c3 None None] [instance: 7dee97a4-9497-43c2-a688-7bedd1441885] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:31:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "11dc4450-74e9-48ab-9de3-024baa6af9f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:40 user nova-compute[71711]: INFO nova.compute.manager [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Terminating instance
Apr 12 06:31:40 user nova-compute[71711]: DEBUG nova.compute.manager [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:31:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-1d65f562-0ab5-4742-92d4-f785f59f0bbc req-7a77b3cc-8ffe-44ed-8a20-1cf29b0a296a service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Received event network-vif-unplugged-3abeb81f-8a9b-40c6-a526-7a10818160b0 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1d65f562-0ab5-4742-92d4-f785f59f0bbc req-7a77b3cc-8ffe-44ed-8a20-1cf29b0a296a service nova] Acquiring lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1d65f562-0ab5-4742-92d4-f785f59f0bbc req-7a77b3cc-8ffe-44ed-8a20-1cf29b0a296a service nova] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1d65f562-0ab5-4742-92d4-f785f59f0bbc req-7a77b3cc-8ffe-44ed-8a20-1cf29b0a296a service nova] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-1d65f562-0ab5-4742-92d4-f785f59f0bbc req-7a77b3cc-8ffe-44ed-8a20-1cf29b0a296a service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] No waiting events found dispatching network-vif-unplugged-3abeb81f-8a9b-40c6-a526-7a10818160b0 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-1d65f562-0ab5-4742-92d4-f785f59f0bbc req-7a77b3cc-8ffe-44ed-8a20-1cf29b0a296a service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Received event network-vif-unplugged-3abeb81f-8a9b-40c6-a526-7a10818160b0 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:41 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Instance destroyed successfully.
Apr 12 06:31:41 user nova-compute[71711]: DEBUG nova.objects.instance [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lazy-loading 'resources' on Instance uuid 11dc4450-74e9-48ab-9de3-024baa6af9f1 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:29:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-872207444',display_name='tempest-VolumesAdminNegativeTest-server-872207444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-872207444',id=21,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:29:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b656fa0bf05484889563c50ccc9a7e9',ramdisk_id='',reservation_id='r-fwf9oncs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1313851069',owner_user_name='tempest-VolumesAdminNegativeTest-1313851069-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:29:54Z,user_data=None,user_id='d682efe6338b4989beb714cce25e8e31',uuid=11dc4450-74e9-48ab-9de3-024baa6af9f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "address": "fa:16:3e:15:f9:0a", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3abeb81f-8a", "ovs_interfaceid": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Converting VIF {"id": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "address": "fa:16:3e:15:f9:0a", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3abeb81f-8a", "ovs_interfaceid": "3abeb81f-8a9b-40c6-a526-7a10818160b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=3abeb81f-8a9b-40c6-a526-7a10818160b0,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3abeb81f-8a') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG os_vif [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=3abeb81f-8a9b-40c6-a526-7a10818160b0,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3abeb81f-8a') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3abeb81f-8a, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:31:41 user nova-compute[71711]: INFO os_vif [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=3abeb81f-8a9b-40c6-a526-7a10818160b0,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3abeb81f-8a')
Apr 12 06:31:41 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Deleting instance files /opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1_del
Apr 12 06:31:41 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Deletion of /opt/stack/data/nova/instances/11dc4450-74e9-48ab-9de3-024baa6af9f1_del complete
Apr 12 06:31:41 user nova-compute[71711]: INFO nova.compute.manager [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 12 06:31:41 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:31:41 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Took 0.48 seconds to deallocate network for instance.
Apr 12 06:31:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-3297d5f6-05c7-43b3-872b-2274626dc94c req-f033b57a-82db-47f9-9f98-00f2b7cb8d11 service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Received event network-vif-deleted-3abeb81f-8a9b-40c6-a526-7a10818160b0 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:42 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:31:42 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:31:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:42 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Deleted allocations for instance 11dc4450-74e9-48ab-9de3-024baa6af9f1
Apr 12 06:31:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-319e42ce-762b-4bd5-9856-f330d3f9686f tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.690s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-4d6b2b53-f09d-427c-b229-1dc30dd0d076 req-d56cd3a2-9c21-4802-ba54-3151e338f94d service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Received event network-vif-plugged-3abeb81f-8a9b-40c6-a526-7a10818160b0 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4d6b2b53-f09d-427c-b229-1dc30dd0d076 req-d56cd3a2-9c21-4802-ba54-3151e338f94d service nova] Acquiring lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4d6b2b53-f09d-427c-b229-1dc30dd0d076 req-d56cd3a2-9c21-4802-ba54-3151e338f94d service nova] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4d6b2b53-f09d-427c-b229-1dc30dd0d076 req-d56cd3a2-9c21-4802-ba54-3151e338f94d service nova] Lock "11dc4450-74e9-48ab-9de3-024baa6af9f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-4d6b2b53-f09d-427c-b229-1dc30dd0d076 req-d56cd3a2-9c21-4802-ba54-3151e338f94d service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] No waiting events found dispatching network-vif-plugged-3abeb81f-8a9b-40c6-a526-7a10818160b0 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:43 user nova-compute[71711]: WARNING nova.compute.manager [req-4d6b2b53-f09d-427c-b229-1dc30dd0d076 req-d56cd3a2-9c21-4802-ba54-3151e338f94d service nova] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Received unexpected event network-vif-plugged-3abeb81f-8a9b-40c6-a526-7a10818160b0 for instance with vm_state deleted and task_state None.
Apr 12 06:31:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:31:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:31:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:31:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:31:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:50 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:31:50 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7722MB free_disk=26.224693298339844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Applying migration context for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 as it has an incoming, in-progress migration b40fbccb-d98f-4362-982f-4301471b7325. Migration status is finished {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 06:31:50 user nova-compute[71711]: INFO nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating resource usage from migration b40fbccb-d98f-4362-982f-4301471b7325
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance d78558e6-437e-44dd-b6b4-123ed3447094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 3770a397-2124-4648-abad-d3ce6483e3b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Migration b40fbccb-d98f-4362-982f-4301471b7325 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:31:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:51 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:31:51 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:31:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:31:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:31:51 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:31:52 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating instance_info_cache with network_info: [{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:31:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:31:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:31:52 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:31:52 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:31:52 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "487bc635-136c-43b1-8cb2-f233a0beaa25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:31:53 user nova-compute[71711]: INFO nova.compute.claims [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Claim successful on node user
Apr 12 06:31:53 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG nova.network.neutron [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:31:53 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:31:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG nova.policy [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67fbba4b2bbc4bb3b2255ef1facd7442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0a755743544f7c97644faad13bdeb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:31:53 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Creating image(s)
Apr 12 06:31:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "/opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "/opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "/opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk 1073741824" returned: 0 in 0.049s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Cannot resize image /opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG nova.objects.instance [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lazy-loading 'migration_context' on Instance uuid 487bc635-136c-43b1-8cb2-f233a0beaa25 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Ensure instance console log exists: /opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Successfully created port: 47d2a1d0-2b44-4c97-a535-93b333238ea6 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Successfully updated port: 47d2a1d0-2b44-4c97-a535-93b333238ea6 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "refresh_cache-487bc635-136c-43b1-8cb2-f233a0beaa25" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquired lock "refresh_cache-487bc635-136c-43b1-8cb2-f233a0beaa25" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Received event network-changed-47d2a1d0-2b44-4c97-a535-93b333238ea6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Refreshing instance network info cache due to event network-changed-47d2a1d0-2b44-4c97-a535-93b333238ea6. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] Acquiring lock "refresh_cache-487bc635-136c-43b1-8cb2-f233a0beaa25" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Updating instance_info_cache with network_info: [{"id": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "address": "fa:16:3e:1a:dc:5f", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d2a1d0-2b", "ovs_interfaceid": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Releasing lock "refresh_cache-487bc635-136c-43b1-8cb2-f233a0beaa25" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.compute.manager [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Instance network_info: |[{"id": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "address": "fa:16:3e:1a:dc:5f", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d2a1d0-2b", "ovs_interfaceid": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] Acquired lock "refresh_cache-487bc635-136c-43b1-8cb2-f233a0beaa25" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.network.neutron [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Refreshing network info cache for port 47d2a1d0-2b44-4c97-a535-93b333238ea6 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Start _get_guest_xml network_info=[{"id": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "address": "fa:16:3e:1a:dc:5f", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d2a1d0-2b", "ovs_interfaceid": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:31:55 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:31:55 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:31:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-166257788',display_name='tempest-VolumesActionsTest-instance-166257788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-166257788',id=24,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0a755743544f7c97644faad13bdeb4',ramdisk_id='',reservation_id='r-lcrzwgkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1914558791',owner_user_name='tempest-VolumesActionsTest-1914558791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:31:54Z,user_data=None,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',uuid=487bc635-136c-43b1-8cb2-f233a0beaa25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "address": "fa:16:3e:1a:dc:5f", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d2a1d0-2b", "ovs_interfaceid": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Converting VIF {"id": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "address": "fa:16:3e:1a:dc:5f", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d2a1d0-2b", "ovs_interfaceid": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:dc:5f,bridge_name='br-int',has_traffic_filtering=True,id=47d2a1d0-2b44-4c97-a535-93b333238ea6,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d2a1d0-2b') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lazy-loading 'pci_devices' on Instance uuid 487bc635-136c-43b1-8cb2-f233a0beaa25 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:31:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:31:55 user nova-compute[71711]:   <uuid>487bc635-136c-43b1-8cb2-f233a0beaa25</uuid>
Apr 12 06:31:55 user nova-compute[71711]:   <name>instance-00000018</name>
Apr 12 06:31:55 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:31:55 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:31:55 user nova-compute[71711]:   <metadata>
Apr 12 06:31:55 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:31:55 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:31:55 user nova-compute[71711]:       <nova:name>tempest-VolumesActionsTest-instance-166257788</nova:name>
Apr 12 06:31:55 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:31:55</nova:creationTime>
Apr 12 06:31:55 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:31:55 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:31:55 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:31:55 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:31:55 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:31:55 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:31:55 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:31:55 user nova-compute[71711]:       <nova:owner>
Apr 12 06:31:55 user nova-compute[71711]:         <nova:user uuid="67fbba4b2bbc4bb3b2255ef1facd7442">tempest-VolumesActionsTest-1914558791-project-member</nova:user>
Apr 12 06:31:55 user nova-compute[71711]:         <nova:project uuid="4d0a755743544f7c97644faad13bdeb4">tempest-VolumesActionsTest-1914558791</nova:project>
Apr 12 06:31:55 user nova-compute[71711]:       </nova:owner>
Apr 12 06:31:55 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:31:55 user nova-compute[71711]:       <nova:ports>
Apr 12 06:31:55 user nova-compute[71711]:         <nova:port uuid="47d2a1d0-2b44-4c97-a535-93b333238ea6">
Apr 12 06:31:55 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:31:55 user nova-compute[71711]:         </nova:port>
Apr 12 06:31:55 user nova-compute[71711]:       </nova:ports>
Apr 12 06:31:55 user nova-compute[71711]:     </nova:instance>
Apr 12 06:31:55 user nova-compute[71711]:   </metadata>
Apr 12 06:31:55 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:31:55 user nova-compute[71711]:     <system>
Apr 12 06:31:55 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:31:55 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:31:55 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:31:55 user nova-compute[71711]:       <entry name="serial">487bc635-136c-43b1-8cb2-f233a0beaa25</entry>
Apr 12 06:31:55 user nova-compute[71711]:       <entry name="uuid">487bc635-136c-43b1-8cb2-f233a0beaa25</entry>
Apr 12 06:31:55 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:31:55 user nova-compute[71711]:     </system>
Apr 12 06:31:55 user nova-compute[71711]:   </sysinfo>
Apr 12 06:31:55 user nova-compute[71711]:   <os>
Apr 12 06:31:55 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:31:55 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:31:55 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:31:55 user nova-compute[71711]:   </os>
Apr 12 06:31:55 user nova-compute[71711]:   <features>
Apr 12 06:31:55 user nova-compute[71711]:     <acpi/>
Apr 12 06:31:55 user nova-compute[71711]:     <apic/>
Apr 12 06:31:55 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:31:55 user nova-compute[71711]:   </features>
Apr 12 06:31:55 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:31:55 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:31:55 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:31:55 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:31:55 user nova-compute[71711]:   </clock>
Apr 12 06:31:55 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:31:55 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:31:55 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:31:55 user nova-compute[71711]:   </cpu>
Apr 12 06:31:55 user nova-compute[71711]:   <devices>
Apr 12 06:31:55 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:31:55 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:31:55 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk"/>
Apr 12 06:31:55 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:31:55 user nova-compute[71711]:     </disk>
Apr 12 06:31:55 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:31:55 user nova-compute[71711]:       <mac address="fa:16:3e:1a:dc:5f"/>
Apr 12 06:31:55 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:31:55 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:31:55 user nova-compute[71711]:       <target dev="tap47d2a1d0-2b"/>
Apr 12 06:31:55 user nova-compute[71711]:     </interface>
Apr 12 06:31:55 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:31:55 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/console.log" append="off"/>
Apr 12 06:31:55 user nova-compute[71711]:     </serial>
Apr 12 06:31:55 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:31:55 user nova-compute[71711]:     <video>
Apr 12 06:31:55 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:31:55 user nova-compute[71711]:     </video>
Apr 12 06:31:55 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:31:55 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:31:55 user nova-compute[71711]:     </rng>
Apr 12 06:31:55 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:31:55 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:31:55 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:31:55 user nova-compute[71711]:     </memballoon>
Apr 12 06:31:55 user nova-compute[71711]:   </devices>
Apr 12 06:31:55 user nova-compute[71711]: </domain>
Apr 12 06:31:55 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:31:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-166257788',display_name='tempest-VolumesActionsTest-instance-166257788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-166257788',id=24,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0a755743544f7c97644faad13bdeb4',ramdisk_id='',reservation_id='r-lcrzwgkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1914558791',owner_user_name='tempest-VolumesActionsTest-1914558791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:31:54Z,user_data=None,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',uuid=487bc635-136c-43b1-8cb2-f233a0beaa25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "address": "fa:16:3e:1a:dc:5f", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d2a1d0-2b", "ovs_interfaceid": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Converting VIF {"id": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "address": "fa:16:3e:1a:dc:5f", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d2a1d0-2b", "ovs_interfaceid": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:dc:5f,bridge_name='br-int',has_traffic_filtering=True,id=47d2a1d0-2b44-4c97-a535-93b333238ea6,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d2a1d0-2b') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG os_vif [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:dc:5f,bridge_name='br-int',has_traffic_filtering=True,id=47d2a1d0-2b44-4c97-a535-93b333238ea6,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d2a1d0-2b') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47d2a1d0-2b, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47d2a1d0-2b, col_values=(('external_ids', {'iface-id': '47d2a1d0-2b44-4c97-a535-93b333238ea6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:dc:5f', 'vm-uuid': '487bc635-136c-43b1-8cb2-f233a0beaa25'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:56 user nova-compute[71711]: INFO os_vif [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:dc:5f,bridge_name='br-int',has_traffic_filtering=True,id=47d2a1d0-2b44-4c97-a535-93b333238ea6,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d2a1d0-2b')
Apr 12 06:31:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] No VIF found with MAC fa:16:3e:1a:dc:5f, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281101.3465798, 11dc4450-74e9-48ab-9de3-024baa6af9f1 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:31:56 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] VM Stopped (Lifecycle Event)
Apr 12 06:31:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ab07f967-265a-4c30-81ff-ac08d0ff2f67 None None] [instance: 11dc4450-74e9-48ab-9de3-024baa6af9f1] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG nova.network.neutron [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Updated VIF entry in instance network info cache for port 47d2a1d0-2b44-4c97-a535-93b333238ea6. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG nova.network.neutron [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Updating instance_info_cache with network_info: [{"id": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "address": "fa:16:3e:1a:dc:5f", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d2a1d0-2b", "ovs_interfaceid": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:31:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2d9680c6-8f12-44a9-a3c9-d3015f497f76 req-8a5ced1a-2cf1-4b3c-a45f-595815fa7ca0 service nova] Releasing lock "refresh_cache-487bc635-136c-43b1-8cb2-f233a0beaa25" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:31:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:57 user nova-compute[71711]: DEBUG nova.compute.manager [req-4bbd9c46-956e-467e-bec3-66a29fdf2e51 req-acc800cd-a230-4a72-b359-35d3ec1df635 service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Received event network-vif-plugged-47d2a1d0-2b44-4c97-a535-93b333238ea6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4bbd9c46-956e-467e-bec3-66a29fdf2e51 req-acc800cd-a230-4a72-b359-35d3ec1df635 service nova] Acquiring lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4bbd9c46-956e-467e-bec3-66a29fdf2e51 req-acc800cd-a230-4a72-b359-35d3ec1df635 service nova] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4bbd9c46-956e-467e-bec3-66a29fdf2e51 req-acc800cd-a230-4a72-b359-35d3ec1df635 service nova] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:57 user nova-compute[71711]: DEBUG nova.compute.manager [req-4bbd9c46-956e-467e-bec3-66a29fdf2e51 req-acc800cd-a230-4a72-b359-35d3ec1df635 service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] No waiting events found dispatching network-vif-plugged-47d2a1d0-2b44-4c97-a535-93b333238ea6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:57 user nova-compute[71711]: WARNING nova.compute.manager [req-4bbd9c46-956e-467e-bec3-66a29fdf2e51 req-acc800cd-a230-4a72-b359-35d3ec1df635 service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Received unexpected event network-vif-plugged-47d2a1d0-2b44-4c97-a535-93b333238ea6 for instance with vm_state building and task_state spawning.
Apr 12 06:31:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281119.489787, 487bc635-136c-43b1-8cb2-f233a0beaa25 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:31:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] VM Resumed (Lifecycle Event)
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:31:59 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Instance spawned successfully.
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:31:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281119.4950643, 487bc635-136c-43b1-8cb2-f233a0beaa25 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:31:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] VM Started (Lifecycle Event)
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:31:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:31:59 user nova-compute[71711]: INFO nova.compute.manager [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Took 5.67 seconds to spawn the instance on the hypervisor.
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:31:59 user nova-compute[71711]: INFO nova.compute.manager [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Took 6.38 seconds to build instance.
Apr 12 06:31:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-beed6cf7-d4de-4964-9955-781094d4cb4d tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.473s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.compute.manager [req-b866f45a-f464-4729-9519-a78c05b914fe req-ac899ec2-9a18-41ce-931e-d7da9447c16b service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Received event network-vif-plugged-47d2a1d0-2b44-4c97-a535-93b333238ea6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b866f45a-f464-4729-9519-a78c05b914fe req-ac899ec2-9a18-41ce-931e-d7da9447c16b service nova] Acquiring lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b866f45a-f464-4729-9519-a78c05b914fe req-ac899ec2-9a18-41ce-931e-d7da9447c16b service nova] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b866f45a-f464-4729-9519-a78c05b914fe req-ac899ec2-9a18-41ce-931e-d7da9447c16b service nova] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:31:59 user nova-compute[71711]: DEBUG nova.compute.manager [req-b866f45a-f464-4729-9519-a78c05b914fe req-ac899ec2-9a18-41ce-931e-d7da9447c16b service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] No waiting events found dispatching network-vif-plugged-47d2a1d0-2b44-4c97-a535-93b333238ea6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:31:59 user nova-compute[71711]: WARNING nova.compute.manager [req-b866f45a-f464-4729-9519-a78c05b914fe req-ac899ec2-9a18-41ce-931e-d7da9447c16b service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Received unexpected event network-vif-plugged-47d2a1d0-2b44-4c97-a535-93b333238ea6 for instance with vm_state active and task_state None.
Apr 12 06:32:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:32:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:32:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:32:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:32:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:08 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:32:09 user nova-compute[71711]: INFO nova.compute.claims [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Claim successful on node user
Apr 12 06:32:09 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:32:09 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:32:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG nova.policy [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd58cc232d0094bebacf147c6b61a0989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f124d62c4d345d9af22f1557abca276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:32:09 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Creating image(s)
Apr 12 06:32:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "/opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "/opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "/opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk 1073741824" returned: 0 in 0.050s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Successfully created port: 0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Cannot resize image /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'migration_context' on Instance uuid 7af3e780-e4f5-4ff6-a086-c77485d7ec67 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Ensure instance console log exists: /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Successfully updated port: 0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Received event network-changed-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Refreshing instance network info cache due to event network-changed-0c59cad7-11ab-4be0-87a4-6e12347b4dd9. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] Acquiring lock "refresh_cache-7af3e780-e4f5-4ff6-a086-c77485d7ec67" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] Acquired lock "refresh_cache-7af3e780-e4f5-4ff6-a086-c77485d7ec67" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.network.neutron [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Refreshing network info cache for port 0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "refresh_cache-7af3e780-e4f5-4ff6-a086-c77485d7ec67" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.network.neutron [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.network.neutron [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7bdde479-f328-4ba5-8340-fee23971541a req-eb9fd9ab-d057-4f56-9a4a-42a8bbe25aea service nova] Releasing lock "refresh_cache-7af3e780-e4f5-4ff6-a086-c77485d7ec67" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquired lock "refresh_cache-7af3e780-e4f5-4ff6-a086-c77485d7ec67" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Updating instance_info_cache with network_info: [{"id": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "address": "fa:16:3e:4d:4f:ac", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59cad7-11", "ovs_interfaceid": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Releasing lock "refresh_cache-7af3e780-e4f5-4ff6-a086-c77485d7ec67" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Instance network_info: |[{"id": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "address": "fa:16:3e:4d:4f:ac", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59cad7-11", "ovs_interfaceid": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Start _get_guest_xml network_info=[{"id": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "address": "fa:16:3e:4d:4f:ac", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59cad7-11", "ovs_interfaceid": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:32:11 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:32:11 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1012542406',display_name='tempest-AttachVolumeTestJSON-server-1012542406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1012542406',id=25,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpZmXYWicFrSyEtfpqfjfAIQY8glRt1/Lngk2QXW7mMzJ4XKM2JZgEBDcZ7pJJqIQepA9AdE8IqzBjQ9qfKnDJiYCtISr/pNtvWIW/u53rEIRJksUDTXtz1fCyVBDg34A==',key_name='tempest-keypair-2126669667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f124d62c4d345d9af22f1557abca276',ramdisk_id='',reservation_id='r-lupdl6i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1680327736',owner_user_name='tempest-AttachVolumeTestJSON-1680327736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:32:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d58cc232d0094bebacf147c6b61a0989',uuid=7af3e780-e4f5-4ff6-a086-c77485d7ec67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "address": "fa:16:3e:4d:4f:ac", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59cad7-11", "ovs_interfaceid": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converting VIF {"id": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "address": "fa:16:3e:4d:4f:ac", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59cad7-11", "ovs_interfaceid": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=0c59cad7-11ab-4be0-87a4-6e12347b4dd9,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59cad7-11') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'pci_devices' on Instance uuid 7af3e780-e4f5-4ff6-a086-c77485d7ec67 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:32:11 user nova-compute[71711]:   <uuid>7af3e780-e4f5-4ff6-a086-c77485d7ec67</uuid>
Apr 12 06:32:11 user nova-compute[71711]:   <name>instance-00000019</name>
Apr 12 06:32:11 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:32:11 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:32:11 user nova-compute[71711]:   <metadata>
Apr 12 06:32:11 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:32:11 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:32:11 user nova-compute[71711]:       <nova:name>tempest-AttachVolumeTestJSON-server-1012542406</nova:name>
Apr 12 06:32:11 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:32:11</nova:creationTime>
Apr 12 06:32:11 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:32:11 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:32:11 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:32:11 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:32:11 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:32:11 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:32:11 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:32:11 user nova-compute[71711]:       <nova:owner>
Apr 12 06:32:11 user nova-compute[71711]:         <nova:user uuid="d58cc232d0094bebacf147c6b61a0989">tempest-AttachVolumeTestJSON-1680327736-project-member</nova:user>
Apr 12 06:32:11 user nova-compute[71711]:         <nova:project uuid="4f124d62c4d345d9af22f1557abca276">tempest-AttachVolumeTestJSON-1680327736</nova:project>
Apr 12 06:32:11 user nova-compute[71711]:       </nova:owner>
Apr 12 06:32:11 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:32:11 user nova-compute[71711]:       <nova:ports>
Apr 12 06:32:11 user nova-compute[71711]:         <nova:port uuid="0c59cad7-11ab-4be0-87a4-6e12347b4dd9">
Apr 12 06:32:11 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 06:32:11 user nova-compute[71711]:         </nova:port>
Apr 12 06:32:11 user nova-compute[71711]:       </nova:ports>
Apr 12 06:32:11 user nova-compute[71711]:     </nova:instance>
Apr 12 06:32:11 user nova-compute[71711]:   </metadata>
Apr 12 06:32:11 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:32:11 user nova-compute[71711]:     <system>
Apr 12 06:32:11 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:32:11 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:32:11 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:32:11 user nova-compute[71711]:       <entry name="serial">7af3e780-e4f5-4ff6-a086-c77485d7ec67</entry>
Apr 12 06:32:11 user nova-compute[71711]:       <entry name="uuid">7af3e780-e4f5-4ff6-a086-c77485d7ec67</entry>
Apr 12 06:32:11 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:32:11 user nova-compute[71711]:     </system>
Apr 12 06:32:11 user nova-compute[71711]:   </sysinfo>
Apr 12 06:32:11 user nova-compute[71711]:   <os>
Apr 12 06:32:11 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:32:11 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:32:11 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:32:11 user nova-compute[71711]:   </os>
Apr 12 06:32:11 user nova-compute[71711]:   <features>
Apr 12 06:32:11 user nova-compute[71711]:     <acpi/>
Apr 12 06:32:11 user nova-compute[71711]:     <apic/>
Apr 12 06:32:11 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:32:11 user nova-compute[71711]:   </features>
Apr 12 06:32:11 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:32:11 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:32:11 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:32:11 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:32:11 user nova-compute[71711]:   </clock>
Apr 12 06:32:11 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:32:11 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:32:11 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:32:11 user nova-compute[71711]:   </cpu>
Apr 12 06:32:11 user nova-compute[71711]:   <devices>
Apr 12 06:32:11 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:32:11 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:32:11 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk"/>
Apr 12 06:32:11 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:32:11 user nova-compute[71711]:     </disk>
Apr 12 06:32:11 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:32:11 user nova-compute[71711]:       <mac address="fa:16:3e:4d:4f:ac"/>
Apr 12 06:32:11 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:32:11 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:32:11 user nova-compute[71711]:       <target dev="tap0c59cad7-11"/>
Apr 12 06:32:11 user nova-compute[71711]:     </interface>
Apr 12 06:32:11 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:32:11 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/console.log" append="off"/>
Apr 12 06:32:11 user nova-compute[71711]:     </serial>
Apr 12 06:32:11 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:32:11 user nova-compute[71711]:     <video>
Apr 12 06:32:11 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:32:11 user nova-compute[71711]:     </video>
Apr 12 06:32:11 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:32:11 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:32:11 user nova-compute[71711]:     </rng>
Apr 12 06:32:11 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:32:11 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:32:11 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:32:11 user nova-compute[71711]:     </memballoon>
Apr 12 06:32:11 user nova-compute[71711]:   </devices>
Apr 12 06:32:11 user nova-compute[71711]: </domain>
Apr 12 06:32:11 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1012542406',display_name='tempest-AttachVolumeTestJSON-server-1012542406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1012542406',id=25,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpZmXYWicFrSyEtfpqfjfAIQY8glRt1/Lngk2QXW7mMzJ4XKM2JZgEBDcZ7pJJqIQepA9AdE8IqzBjQ9qfKnDJiYCtISr/pNtvWIW/u53rEIRJksUDTXtz1fCyVBDg34A==',key_name='tempest-keypair-2126669667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f124d62c4d345d9af22f1557abca276',ramdisk_id='',reservation_id='r-lupdl6i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1680327736',owner_user_name='tempest-AttachVolumeTestJSON-1680327736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:32:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d58cc232d0094bebacf147c6b61a0989',uuid=7af3e780-e4f5-4ff6-a086-c77485d7ec67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "address": "fa:16:3e:4d:4f:ac", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59cad7-11", "ovs_interfaceid": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converting VIF {"id": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "address": "fa:16:3e:4d:4f:ac", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59cad7-11", "ovs_interfaceid": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=0c59cad7-11ab-4be0-87a4-6e12347b4dd9,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59cad7-11') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG os_vif [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=0c59cad7-11ab-4be0-87a4-6e12347b4dd9,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59cad7-11') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c59cad7-11, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c59cad7-11, col_values=(('external_ids', {'iface-id': '0c59cad7-11ab-4be0-87a4-6e12347b4dd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:4f:ac', 'vm-uuid': '7af3e780-e4f5-4ff6-a086-c77485d7ec67'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:11 user nova-compute[71711]: INFO os_vif [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=0c59cad7-11ab-4be0-87a4-6e12347b4dd9,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59cad7-11')
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:32:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No VIF found with MAC fa:16:3e:4d:4f:ac, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:32:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-a62f2702-7cbd-4a37-a80c-4bc37071f3de req-aab2f42e-18b5-4fbd-95ea-402196368ebe service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Received event network-vif-plugged-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:32:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a62f2702-7cbd-4a37-a80c-4bc37071f3de req-aab2f42e-18b5-4fbd-95ea-402196368ebe service nova] Acquiring lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a62f2702-7cbd-4a37-a80c-4bc37071f3de req-aab2f42e-18b5-4fbd-95ea-402196368ebe service nova] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a62f2702-7cbd-4a37-a80c-4bc37071f3de req-aab2f42e-18b5-4fbd-95ea-402196368ebe service nova] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-a62f2702-7cbd-4a37-a80c-4bc37071f3de req-aab2f42e-18b5-4fbd-95ea-402196368ebe service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] No waiting events found dispatching network-vif-plugged-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:32:13 user nova-compute[71711]: WARNING nova.compute.manager [req-a62f2702-7cbd-4a37-a80c-4bc37071f3de req-aab2f42e-18b5-4fbd-95ea-402196368ebe service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Received unexpected event network-vif-plugged-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 for instance with vm_state building and task_state spawning.
Apr 12 06:32:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281135.117394, 7af3e780-e4f5-4ff6-a086-c77485d7ec67 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:32:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] VM Resumed (Lifecycle Event)
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:32:15 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Instance spawned successfully.
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:32:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281135.1197758, 7af3e780-e4f5-4ff6-a086-c77485d7ec67 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:32:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] VM Started (Lifecycle Event)
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:32:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:32:15 user nova-compute[71711]: INFO nova.compute.manager [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Took 5.59 seconds to spawn the instance on the hypervisor.
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-7f39bfc0-1f85-49e0-a9aa-a92e6af5306a req-36c4544e-84ae-4242-be55-7deabfaca3c2 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Received event network-vif-plugged-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7f39bfc0-1f85-49e0-a9aa-a92e6af5306a req-36c4544e-84ae-4242-be55-7deabfaca3c2 service nova] Acquiring lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7f39bfc0-1f85-49e0-a9aa-a92e6af5306a req-36c4544e-84ae-4242-be55-7deabfaca3c2 service nova] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7f39bfc0-1f85-49e0-a9aa-a92e6af5306a req-36c4544e-84ae-4242-be55-7deabfaca3c2 service nova] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-7f39bfc0-1f85-49e0-a9aa-a92e6af5306a req-36c4544e-84ae-4242-be55-7deabfaca3c2 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] No waiting events found dispatching network-vif-plugged-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:32:15 user nova-compute[71711]: WARNING nova.compute.manager [req-7f39bfc0-1f85-49e0-a9aa-a92e6af5306a req-36c4544e-84ae-4242-be55-7deabfaca3c2 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Received unexpected event network-vif-plugged-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 for instance with vm_state building and task_state spawning.
Apr 12 06:32:15 user nova-compute[71711]: INFO nova.compute.manager [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Took 6.34 seconds to build instance.
Apr 12 06:32:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7bc23285-6201-4f4f-87e9-c4d300cc2c7b tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.435s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:32:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:32:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:32:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:32:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Received event network-changed-8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:32:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Refreshing instance network info cache due to event network-changed-8bb8777b-5b83-47be-ab13-4ad7fd67d66c. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:32:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] Acquiring lock "refresh_cache-3770a397-2124-4648-abad-d3ce6483e3b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:32:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] Acquired lock "refresh_cache-3770a397-2124-4648-abad-d3ce6483e3b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:32:29 user nova-compute[71711]: DEBUG nova.network.neutron [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Refreshing network info cache for port 8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG nova.objects.instance [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'flavor' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:30 user nova-compute[71711]: INFO nova.compute.manager [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Attaching volume 9545da1e-1977-434b-9228-c5c2ff1cc9fc to /dev/vdb
Apr 12 06:32:30 user nova-compute[71711]: DEBUG os_brick.utils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG nova.network.neutron [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Updated VIF entry in instance network info cache for port 8bb8777b-5b83-47be-ab13-4ad7fd67d66c. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG nova.network.neutron [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Updating instance_info_cache with network_info: [{"id": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "address": "fa:16:3e:5b:66:97", "network": {"id": "4d619acb-e553-4fd8-ab04-623325eaf182", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-502354801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebdd9f4006d413686bba37f22374759", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8777b-5b", "ovs_interfaceid": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f611392-db6c-43e5-b98a-8ef1beb82a33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76f329e7-1f44-44ee-a026-50550c0efdb1 req-04f1dea4-a2ad-43f9-9035-e002709b670e service nova] Releasing lock "refresh_cache-3770a397-2124-4648-abad-d3ce6483e3b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[511f625a-6fec-4aa4-bcd5-8e3191383528]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a00d809-1552-4d66-9796-426d2e4e957e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e810c896-32f5-4788-9b64-cb8696fe9abb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:32:30 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:32:30 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9843de9-7624-4bea-a27b-0670208a908f]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG os_brick.utils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:32:30 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Updating existing volume attachment record: 3818845c-af14-45a6-8b96-35d5a0cfb8bb {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:32:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:32 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Port 8fba3fe8-62b6-46be-a025-3ec5a629ee80 binding to destination host user is already ACTIVE {{(pid=71711) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 06:32:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:32:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquired lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:32:32 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating instance_info_cache with network_info: [{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Releasing lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Creating tmpfile /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/tmpz6fgxhye to verify with other compute node that the instance is on the same shared storage. {{(pid=71711) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-edb69640-15d9-4c8f-9789-6b4ef7791847 req-2878e5b3-af5f-46bb-b734-bf2c13af1ada service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-edb69640-15d9-4c8f-9789-6b4ef7791847 req-2878e5b3-af5f-46bb-b734-bf2c13af1ada service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-edb69640-15d9-4c8f-9789-6b4ef7791847 req-2878e5b3-af5f-46bb-b734-bf2c13af1ada service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-edb69640-15d9-4c8f-9789-6b4ef7791847 req-2878e5b3-af5f-46bb-b734-bf2c13af1ada service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-edb69640-15d9-4c8f-9789-6b4ef7791847 req-2878e5b3-af5f-46bb-b734-bf2c13af1ada service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:32:33 user nova-compute[71711]: WARNING nova.compute.manager [req-edb69640-15d9-4c8f-9789-6b4ef7791847 req-2878e5b3-af5f-46bb-b734-bf2c13af1ada service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state resized and task_state resize_reverting.
Apr 12 06:32:33 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance destroyed successfully.
Apr 12 06:32:33 user nova-compute[71711]: DEBUG nova.objects.instance [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'resources' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1807692588',display_name='tempest-ServerActionsTestJSON-server-1279128249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1807692588',id=4,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-hktvsdi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:30:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=5b5758b9-4f7e-4e85-8181-e3dfdd84e624,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG os_vif [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fba3fe8-62, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:32:33 user nova-compute[71711]: INFO os_vif [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62')
Apr 12 06:32:33 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:32:33 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:32:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b460b05e-55c0-46ec-b8da-c551a670c5f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:32:33 user nova-compute[71711]: No targets found.
Apr 12 06:32:33 user nova-compute[71711]: iSNS:
Apr 12 06:32:33 user nova-compute[71711]: No targets found.
Apr 12 06:32:33 user nova-compute[71711]: STATIC:
Apr 12 06:32:33 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7
Apr 12 06:32:33 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:32:33 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:32:33 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:32:33 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:32:33 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:32:33 user nova-compute[71711]: FIRMWARE:
Apr 12 06:32:33 user nova-compute[71711]: No targets found.
Apr 12 06:32:33 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:32:33 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:32:33 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:32:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[654aeb7c-4597-4a13-aeca-e00d630d2e7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea30eff-6235-44f0-a8c1-dd6d3a0b7fe1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:32:34 user nova-compute[71711]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:32:34 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:32:34 user nova-compute[71711]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:32:34 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f99543ae5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7'): ({'sdc'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Removing single pathed devices sdc {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4c8ccb-690d-4b08-8399-106c087b8109]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ee494e-5b9b-4e40-9ed9-c24d6b51b044]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flushing IO for device /dev/sdc {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5aed26-cc56-4077-8b2b-e79621c05456]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5108a380-ad74-4d35-b4b7-8a37b477ff89]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6a41c6-4557-430e-8bff-b1364aec0ba2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[224cd8bd-32fd-48b5-940c-32de2ece77cb]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260]
Apr 12 06:32:34 user nova-compute[71711]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260] successful.
Apr 12 06:32:34 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4259d3e5-d2a3-4795-bd45-5002de2f6605]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== disconnect_volume: return (287ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flWMIBLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:32:34 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:32:34 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:32:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:32:34 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:32:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a68964f-2093-427d-b5ca-60b00f719736]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:32:35 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5558f953-411b-4180-91d0-41bdf128f7f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc] added
Apr 12 06:32:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb9e522-1397-4260-a6cd-764a37f0a446]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[857f113b-c08f-4fa8-9e87-6e200fcd0db0]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v flWMIBLP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v flWMIBLP" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[67525c33-0aea-43b2-b0a7-e260918b6f19]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'flWMIBLP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb3e958-b66d-43f9-bbdf-30033dbad47c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19ed530-62b2-44bf-b4dd-8196cad51c5f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:32:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:32:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG nova.objects.instance [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'migration_context' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f578bf9-d3ca-4567-8d94-c772b8ad055d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc, portal: 172.16.0.220,3260]
Apr 12 06:32:35 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc, portal: 172.16.0.220,3260] successful.
Apr 12 06:32:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4249858-dfab-4778-9c7e-0834792ad20f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49af007-c182-4eaa-bb66-5898018dc030]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:32:35 user nova-compute[71711]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc (non-flash)
Apr 12 06:32:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:32:35 user nova-compute[71711]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc (non-flash)
Apr 12 06:32:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[86359c0c-ded3-4b44-b17b-941f481f0aec]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flWMIBLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-9b9b80ef-6f6e-44a2-9cb1-26f31d9f4683 req-7b6fbad0-1273-4551-bdc4-8d3981dd94bb service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9b9b80ef-6f6e-44a2-9cb1-26f31d9f4683 req-7b6fbad0-1273-4551-bdc4-8d3981dd94bb service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9b9b80ef-6f6e-44a2-9cb1-26f31d9f4683 req-7b6fbad0-1273-4551-bdc4-8d3981dd94bb service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9b9b80ef-6f6e-44a2-9cb1-26f31d9f4683 req-7b6fbad0-1273-4551-bdc4-8d3981dd94bb service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-9b9b80ef-6f6e-44a2-9cb1-26f31d9f4683 req-7b6fbad0-1273-4551-bdc4-8d3981dd94bb service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:32:35 user nova-compute[71711]: WARNING nova.compute.manager [req-9b9b80ef-6f6e-44a2-9cb1-26f31d9f4683 req-7b6fbad0-1273-4551-bdc4-8d3981dd94bb service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state resized and task_state resize_reverting.
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.430s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:35 user nova-compute[71711]: INFO nova.compute.manager [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Swapping old allocation on dict_keys(['1e1b2f58-6c32-4311-9037-c28244d485c6']) held by migration b40fbccb-d98f-4362-982f-4301471b7325 for instance
Apr 12 06:32:35 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Overwriting current allocation {'allocations': {'1e1b2f58-6c32-4311-9037-c28244d485c6': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 30}}, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'consumer_generation': 1} on consumer 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquired lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:32:35 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23533323038376461', 'path': '/dev/sdc'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533323038376461', 'path': '/dev/sdc'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG nova.objects.instance [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'flavor' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:32:36 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:32:36 user nova-compute[71711]:   <source dev="/dev/sdc"/>
Apr 12 06:32:36 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:32:36 user nova-compute[71711]:   <serial>9545da1e-1977-434b-9228-c5c2ff1cc9fc</serial>
Apr 12 06:32:36 user nova-compute[71711]: </disk>
Apr 12 06:32:36 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating instance_info_cache with network_info: [{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Releasing lock "refresh_cache-5b5758b9-4f7e-4e85-8181-e3dfdd84e624" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG os_brick.utils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1197aa66-a344-4aa2-872d-d4b84f551781]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[72038535-a036-4670-b63b-b04e5109b556]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd7fd1e-1b9d-416c-8c49-688ad3d00ed6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bf3e9a-e236-4565-b62d-14ea8e45fbd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:32:36 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d01ebb-9083-4498-97ce-dfed36117daa]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG os_brick.utils [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No VIF found with MAC fa:16:3e:5b:66:97, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c7644f6f-a6b4-4b6c-95e1-7246a1334c93 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.652s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "d78558e6-437e-44dd-b6b4-123ed3447094" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "d78558e6-437e-44dd-b6b4-123ed3447094" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:36 user nova-compute[71711]: INFO nova.compute.manager [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Terminating instance
Apr 12 06:32:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3a2f866-c9cd-4bd2-95c5-57138ffc0aaa req-c48104f7-d6a8-474f-a23f-1bdc20f32720 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Received event network-vif-unplugged-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3a2f866-c9cd-4bd2-95c5-57138ffc0aaa req-c48104f7-d6a8-474f-a23f-1bdc20f32720 service nova] Acquiring lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3a2f866-c9cd-4bd2-95c5-57138ffc0aaa req-c48104f7-d6a8-474f-a23f-1bdc20f32720 service nova] Lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3a2f866-c9cd-4bd2-95c5-57138ffc0aaa req-c48104f7-d6a8-474f-a23f-1bdc20f32720 service nova] Lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3a2f866-c9cd-4bd2-95c5-57138ffc0aaa req-c48104f7-d6a8-474f-a23f-1bdc20f32720 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] No waiting events found dispatching network-vif-unplugged-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3a2f866-c9cd-4bd2-95c5-57138ffc0aaa req-c48104f7-d6a8-474f-a23f-1bdc20f32720 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Received event network-vif-unplugged-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:32:37 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Instance destroyed successfully.
Apr 12 06:32:37 user nova-compute[71711]: DEBUG nova.objects.instance [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lazy-loading 'resources' on Instance uuid d78558e6-437e-44dd-b6b4-123ed3447094 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-322960618',display_name='tempest-VolumesAdminNegativeTest-server-322960618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-322960618',id=16,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD65dE2pmIa6Mfx/K+bCSPXnuq3dvIWAreTtSp1xAwHIKyD+AYVbf8VY+daMgeHQNbUc8pnSFCiLNei+4la99e6HF1pBOjNJp35njArMoDgjdZo+g6dLiFEWe9TBcGXsNg==',key_name='tempest-keypair-1771315456',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:27:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b656fa0bf05484889563c50ccc9a7e9',ramdisk_id='',reservation_id='r-yxqyyqa0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1313851069',owner_user_name='tempest-VolumesAdminNegativeTest-1313851069-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d682efe6338b4989beb714cce25e8e31',uuid=d78558e6-437e-44dd-b6b4-123ed3447094,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "address": "fa:16:3e:c2:55:e5", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fc0ea9-eb", "ovs_interfaceid": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Converting VIF {"id": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "address": "fa:16:3e:c2:55:e5", "network": {"id": "dcf0c385-b3ea-4b92-8d8d-a0e1243f6189", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-98796855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b656fa0bf05484889563c50ccc9a7e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9fc0ea9-eb", "ovs_interfaceid": "b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:55:e5,bridge_name='br-int',has_traffic_filtering=True,id=b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fc0ea9-eb') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG os_vif [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:55:e5,bridge_name='br-int',has_traffic_filtering=True,id=b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fc0ea9-eb') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9fc0ea9-eb, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:32:37 user nova-compute[71711]: INFO os_vif [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:55:e5,bridge_name='br-int',has_traffic_filtering=True,id=b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea,network=Network(dcf0c385-b3ea-4b92-8d8d-a0e1243f6189),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9fc0ea9-eb')
Apr 12 06:32:37 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Deleting instance files /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094_del
Apr 12 06:32:37 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Deletion of /opt/stack/data/nova/instances/d78558e6-437e-44dd-b6b4-123ed3447094_del complete
Apr 12 06:32:37 user nova-compute[71711]: INFO nova.compute.manager [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 06:32:37 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:32:37 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:32:38 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:32:38 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Took 0.71 seconds to deallocate network for instance.
Apr 12 06:32:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-1f833f0e-311b-48ab-8dd5-6b3f2f1ba806 req-958c1413-0a87-4499-9488-da201f101d31 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Received event network-vif-deleted-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:32:38 user nova-compute[71711]: INFO nova.compute.manager [req-1f833f0e-311b-48ab-8dd5-6b3f2f1ba806 req-958c1413-0a87-4499-9488-da201f101d31 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Neutron deleted interface b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea; detaching it from the instance and deleting it from the info cache
Apr 12 06:32:38 user nova-compute[71711]: DEBUG nova.network.neutron [req-1f833f0e-311b-48ab-8dd5-6b3f2f1ba806 req-958c1413-0a87-4499-9488-da201f101d31 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:32:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-1f833f0e-311b-48ab-8dd5-6b3f2f1ba806 req-958c1413-0a87-4499-9488-da201f101d31 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Detach interface failed, port_id=b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea, reason: Instance d78558e6-437e-44dd-b6b4-123ed3447094 could not be found. {{(pid=71711) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 06:32:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:39 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:32:39 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:32:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:39 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Deleted allocations for instance d78558e6-437e-44dd-b6b4-123ed3447094
Apr 12 06:32:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d81e41f9-5c25-4b50-9293-8252b890c55b tempest-VolumesAdminNegativeTest-1313851069 tempest-VolumesAdminNegativeTest-1313851069-project-member] Lock "d78558e6-437e-44dd-b6b4-123ed3447094" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.312s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-a21bab07-765e-4371-b07e-41175ef23cbb req-3864c550-cb24-468a-8d7a-75bfff4e4638 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Received event network-vif-plugged-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:32:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a21bab07-765e-4371-b07e-41175ef23cbb req-3864c550-cb24-468a-8d7a-75bfff4e4638 service nova] Acquiring lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a21bab07-765e-4371-b07e-41175ef23cbb req-3864c550-cb24-468a-8d7a-75bfff4e4638 service nova] Lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a21bab07-765e-4371-b07e-41175ef23cbb req-3864c550-cb24-468a-8d7a-75bfff4e4638 service nova] Lock "d78558e6-437e-44dd-b6b4-123ed3447094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-a21bab07-765e-4371-b07e-41175ef23cbb req-3864c550-cb24-468a-8d7a-75bfff4e4638 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] No waiting events found dispatching network-vif-plugged-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:32:39 user nova-compute[71711]: WARNING nova.compute.manager [req-a21bab07-765e-4371-b07e-41175ef23cbb req-3864c550-cb24-468a-8d7a-75bfff4e4638 service nova] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Received unexpected event network-vif-plugged-b9fc0ea9-ebac-4bbc-92d9-6c28b25ff8ea for instance with vm_state deleted and task_state None.
Apr 12 06:32:40 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Starting finish_revert_migration {{(pid=71711) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Start _get_guest_xml network_info=[{"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5b5758b9-4f7e-4e85-8181-e3dfdd84e624', 'attached_at': '2023-04-12T06:32:41.000000', 'detached_at': '', 'volume_id': 'c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'serial': 'c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7'}, 'attachment_id': '856f0332-b737-476e-a57a-88ab04e8a750', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:32:41 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:32:41 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.objects.instance [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:32:41 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:32:41 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:32:41 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5c06da-a7f4-4542-b5e8-8e290ac3ac89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:32:41 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe12871-e7be-400d-9dc6-8fb45bafcc6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7] added
Apr 12 06:32:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[50199302-dae5-49b5-97d9-ff8c3af03665]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab11858d-2516-49c7-b30a-107f81399267]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akKCItqp {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akKCItqp" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8735d0a9-20b7-4efa-a62d-81e370f65b8d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'akKCItqp'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c092656-d1e3-4823-880d-962166034852]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71d8a86-a658-4d61-8004-9f78b59e2e96]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:32:41 user nova-compute[71711]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc (non-flash)
Apr 12 06:32:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:32:41 user nova-compute[71711]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc (non-flash)
Apr 12 06:32:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[045a72b5-e216-48df-9245-8200545cacf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260]
Apr 12 06:32:41 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260] successful.
Apr 12 06:32:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4e7a14-8b83-4aaf-bd1a-001b81005225]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d26b861-d879-429e-a3bd-8a7a930bd0b8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:32:41 user nova-compute[71711]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc (non-flash)
Apr 12 06:32:41 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:32:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:32:41 user nova-compute[71711]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc (non-flash)
Apr 12 06:32:41 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:32:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e13de7-69f7-4fe6-b806-3414f3052013]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26538346464396661', 'path': '/dev/sdd'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538346464396661', 'path': '/dev/sdd'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1807692588',display_name='tempest-ServerActionsTestJSON-server-1279128249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1807692588',id=4,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-hktvsdi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:32:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=5b5758b9-4f7e-4e85-8181-e3dfdd84e624,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:32:42 user nova-compute[71711]:   <uuid>5b5758b9-4f7e-4e85-8181-e3dfdd84e624</uuid>
Apr 12 06:32:42 user nova-compute[71711]:   <name>instance-00000004</name>
Apr 12 06:32:42 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:32:42 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:32:42 user nova-compute[71711]:   <metadata>
Apr 12 06:32:42 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:32:42 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:32:42 user nova-compute[71711]:       <nova:name>tempest-ServerActionsTestJSON-server-1279128249</nova:name>
Apr 12 06:32:42 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:32:41</nova:creationTime>
Apr 12 06:32:42 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:32:42 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:32:42 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:32:42 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:32:42 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:32:42 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:32:42 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:32:42 user nova-compute[71711]:       <nova:owner>
Apr 12 06:32:42 user nova-compute[71711]:         <nova:user uuid="ad316acdc89947bbba60c75e9a24d7e9">tempest-ServerActionsTestJSON-752347644-project-member</nova:user>
Apr 12 06:32:42 user nova-compute[71711]:         <nova:project uuid="54fd87c4105246c1ac1bdf424c83b7aa">tempest-ServerActionsTestJSON-752347644</nova:project>
Apr 12 06:32:42 user nova-compute[71711]:       </nova:owner>
Apr 12 06:32:42 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:32:42 user nova-compute[71711]:       <nova:ports>
Apr 12 06:32:42 user nova-compute[71711]:         <nova:port uuid="8fba3fe8-62b6-46be-a025-3ec5a629ee80">
Apr 12 06:32:42 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 06:32:42 user nova-compute[71711]:         </nova:port>
Apr 12 06:32:42 user nova-compute[71711]:       </nova:ports>
Apr 12 06:32:42 user nova-compute[71711]:     </nova:instance>
Apr 12 06:32:42 user nova-compute[71711]:   </metadata>
Apr 12 06:32:42 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:32:42 user nova-compute[71711]:     <system>
Apr 12 06:32:42 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:32:42 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:32:42 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:32:42 user nova-compute[71711]:       <entry name="serial">5b5758b9-4f7e-4e85-8181-e3dfdd84e624</entry>
Apr 12 06:32:42 user nova-compute[71711]:       <entry name="uuid">5b5758b9-4f7e-4e85-8181-e3dfdd84e624</entry>
Apr 12 06:32:42 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:32:42 user nova-compute[71711]:     </system>
Apr 12 06:32:42 user nova-compute[71711]:   </sysinfo>
Apr 12 06:32:42 user nova-compute[71711]:   <os>
Apr 12 06:32:42 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:32:42 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:32:42 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:32:42 user nova-compute[71711]:   </os>
Apr 12 06:32:42 user nova-compute[71711]:   <features>
Apr 12 06:32:42 user nova-compute[71711]:     <acpi/>
Apr 12 06:32:42 user nova-compute[71711]:     <apic/>
Apr 12 06:32:42 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:32:42 user nova-compute[71711]:   </features>
Apr 12 06:32:42 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:32:42 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:32:42 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:32:42 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:32:42 user nova-compute[71711]:   </clock>
Apr 12 06:32:42 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:32:42 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:32:42 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:32:42 user nova-compute[71711]:   </cpu>
Apr 12 06:32:42 user nova-compute[71711]:   <devices>
Apr 12 06:32:42 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:32:42 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:32:42 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk"/>
Apr 12 06:32:42 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:32:42 user nova-compute[71711]:     </disk>
Apr 12 06:32:42 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:32:42 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:32:42 user nova-compute[71711]:       <source dev="/dev/sdd"/>
Apr 12 06:32:42 user nova-compute[71711]:       <target dev="vdb" bus="virtio"/>
Apr 12 06:32:42 user nova-compute[71711]:       <serial>c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7</serial>
Apr 12 06:32:42 user nova-compute[71711]:     </disk>
Apr 12 06:32:42 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:32:42 user nova-compute[71711]:       <mac address="fa:16:3e:7c:bb:4d"/>
Apr 12 06:32:42 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:32:42 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:32:42 user nova-compute[71711]:       <target dev="tap8fba3fe8-62"/>
Apr 12 06:32:42 user nova-compute[71711]:     </interface>
Apr 12 06:32:42 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:32:42 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/console.log" append="off"/>
Apr 12 06:32:42 user nova-compute[71711]:     </serial>
Apr 12 06:32:42 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:32:42 user nova-compute[71711]:     <video>
Apr 12 06:32:42 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:32:42 user nova-compute[71711]:     </video>
Apr 12 06:32:42 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:32:42 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:32:42 user nova-compute[71711]:     </rng>
Apr 12 06:32:42 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:32:42 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:32:42 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:32:42 user nova-compute[71711]:     </memballoon>
Apr 12 06:32:42 user nova-compute[71711]:   </devices>
Apr 12 06:32:42 user nova-compute[71711]: </domain>
Apr 12 06:32:42 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1807692588',display_name='tempest-ServerActionsTestJSON-server-1279128249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1807692588',id=4,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:30:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-hktvsdi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:32:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=5b5758b9-4f7e-4e85-8181-e3dfdd84e624,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG os_vif [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fba3fe8-62, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8fba3fe8-62, col_values=(('external_ids', {'iface-id': '8fba3fe8-62b6-46be-a025-3ec5a629ee80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:bb:4d', 'vm-uuid': '5b5758b9-4f7e-4e85-8181-e3dfdd84e624'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:32:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:42 user nova-compute[71711]: INFO os_vif [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62')
Apr 12 06:32:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:43 user nova-compute[71711]: INFO nova.compute.manager [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Detaching volume 9545da1e-1977-434b-9228-c5c2ff1cc9fc
Apr 12 06:32:43 user nova-compute[71711]: INFO nova.virt.block_device [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Attempting to driver detach volume 9545da1e-1977-434b-9228-c5c2ff1cc9fc from mountpoint /dev/vdb
Apr 12 06:32:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Attempting to detach device vdb from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:32:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:32:43 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:32:43 user nova-compute[71711]:   <source dev="/dev/sdc"/>
Apr 12 06:32:43 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:32:43 user nova-compute[71711]:   <serial>9545da1e-1977-434b-9228-c5c2ff1cc9fc</serial>
Apr 12 06:32:43 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:32:43 user nova-compute[71711]: </disk>
Apr 12 06:32:43 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:32:43 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Successfully detached device vdb from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the persistent domain config.
Apr 12 06:32:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:32:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:32:43 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:32:43 user nova-compute[71711]:   <source dev="/dev/sdc"/>
Apr 12 06:32:43 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:32:43 user nova-compute[71711]:   <serial>9545da1e-1977-434b-9228-c5c2ff1cc9fc</serial>
Apr 12 06:32:43 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:32:43 user nova-compute[71711]: </disk>
Apr 12 06:32:43 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:32:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681281164.0615072, 3770a397-2124-4648-abad-d3ce6483e3b2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:32:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Successfully detached device vdb from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the live domain config.
Apr 12 06:32:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flWMIBLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:32:44 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[206d80dd-9698-4a0b-883a-4e25d02c963c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:32:44 user nova-compute[71711]: No targets found.
Apr 12 06:32:44 user nova-compute[71711]: iSNS:
Apr 12 06:32:44 user nova-compute[71711]: No targets found.
Apr 12 06:32:44 user nova-compute[71711]: STATIC:
Apr 12 06:32:44 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc
Apr 12 06:32:44 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:32:44 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:32:44 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7
Apr 12 06:32:44 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:32:44 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:32:44 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:32:44 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:32:44 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:32:44 user nova-compute[71711]: FIRMWARE:
Apr 12 06:32:44 user nova-compute[71711]: No targets found.
Apr 12 06:32:44 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:32:44 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:32:44 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b22a84-d82b-41ca-81e4-54ee1b74481c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44f9242-ae51-4af6-94fe-5a12c1eedf4d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:32:44 user nova-compute[71711]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc (non-flash)
Apr 12 06:32:44 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:32:44 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:32:44 user nova-compute[71711]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc (non-flash)
Apr 12 06:32:44 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:32:44 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9961fd0940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc'): ({'sdc'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Removing single pathed devices sdc {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c895bc7b-2a65-454e-8689-868e9b9d89ad]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[344de2e2-c8c9-4a0e-94d5-a9ac2d894d66]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Flushing IO for device /dev/sdc {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5adf929-4bcf-4b08-b678-72865162472f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba29b44-3487-4df9-97a5-e369d364bb93]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d383896-0777-4ed8-84c3-bdaff11e98f4]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6be573-6c6d-4e25-b747-7fa9cfae5296]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc, portal: 172.16.0.220,3260]
Apr 12 06:32:44 user nova-compute[71711]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc, portal: 172.16.0.220,3260] successful.
Apr 12 06:32:44 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9545da1e-1977-434b-9228-c5c2ff1cc9fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[572b9b8d-57c7-4258-aab1-dae2aa00e6aa]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] <== disconnect_volume: return (326ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-a78a4382-fcc0-440f-a31e-290518f10146 req-33f475ab-d7af-4f95-8cd3-c1c18387329b service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a78a4382-fcc0-440f-a31e-290518f10146 req-33f475ab-d7af-4f95-8cd3-c1c18387329b service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a78a4382-fcc0-440f-a31e-290518f10146 req-33f475ab-d7af-4f95-8cd3-c1c18387329b service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a78a4382-fcc0-440f-a31e-290518f10146 req-33f475ab-d7af-4f95-8cd3-c1c18387329b service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-a78a4382-fcc0-440f-a31e-290518f10146 req-33f475ab-d7af-4f95-8cd3-c1c18387329b service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:32:44 user nova-compute[71711]: WARNING nova.compute.manager [req-a78a4382-fcc0-440f-a31e-290518f10146 req-33f475ab-d7af-4f95-8cd3-c1c18387329b service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state resized and task_state resize_reverting.
Apr 12 06:32:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:32:45 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'flavor' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:32:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ee54ff2c-bcfa-4c6f-9aa3-85bf2c3c5052 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.027s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:46 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:32:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:32:46 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281166.7214513, 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:32:46 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] VM Resumed (Lifecycle Event)
Apr 12 06:32:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:32:46 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance running successfully.
Apr 12 06:32:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] finish_revert_migration finished successfully. {{(pid=71711) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 12 06:32:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:32:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:32:46 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 06:32:46 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281166.7227783, 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:32:46 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] VM Started (Lifecycle Event)
Apr 12 06:32:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:32:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:32:46 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 06:32:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-0621de15-3035-41c3-b43b-d17daa1b3a48 req-340e3d41-eee3-4eb0-bc74-0840c8f80bea service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:32:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0621de15-3035-41c3-b43b-d17daa1b3a48 req-340e3d41-eee3-4eb0-bc74-0840c8f80bea service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0621de15-3035-41c3-b43b-d17daa1b3a48 req-340e3d41-eee3-4eb0-bc74-0840c8f80bea service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0621de15-3035-41c3-b43b-d17daa1b3a48 req-340e3d41-eee3-4eb0-bc74-0840c8f80bea service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-0621de15-3035-41c3-b43b-d17daa1b3a48 req-340e3d41-eee3-4eb0-bc74-0840c8f80bea service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:32:46 user nova-compute[71711]: WARNING nova.compute.manager [req-0621de15-3035-41c3-b43b-d17daa1b3a48 req-340e3d41-eee3-4eb0-bc74-0840c8f80bea service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state resized and task_state resize_reverting.
Apr 12 06:32:46 user nova-compute[71711]: INFO nova.compute.manager [None req-2aa97b26-595d-4611-a9b8-daed9a37f831 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating instance to original state: 'active'
Apr 12 06:32:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:32:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:32:51 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:32:51 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7739MB free_disk=26.21328353881836GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 3770a397-2124-4648-abad-d3ce6483e3b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 487bc635-136c-43b1-8cb2-f233a0beaa25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing inventories for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating ProviderTree inventory for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating inventory in ProviderTree for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing aggregate associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, aggregates: None {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 06:32:51 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing trait associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, traits: HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 06:32:52 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:32:52 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:32:52 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:32:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:32:52 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:32:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 06:32:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] There are 0 instances to clean {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 06:32:52 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:32:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71711) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 06:32:52 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281157.7354295, d78558e6-437e-44dd-b6b4-123ed3447094 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:32:52 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] VM Stopped (Lifecycle Event)
Apr 12 06:32:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5a1bb1ed-5126-4ecc-840c-e0b46b439744 None None] [instance: d78558e6-437e-44dd-b6b4-123ed3447094] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:32:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:32:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:32:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:32:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:32:53 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:32:53 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Updating instance_info_cache with network_info: [{"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:32:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:32:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:32:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:32:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:32:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:32:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:32:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:32:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:02 user nova-compute[71711]: INFO nova.compute.manager [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Unrescuing
Apr 12 06:33:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:33:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquired lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:33:02 user nova-compute[71711]: DEBUG nova.network.neutron [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:33:03 user nova-compute[71711]: DEBUG nova.network.neutron [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Updating instance_info_cache with network_info: [{"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:33:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Releasing lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:33:03 user nova-compute[71711]: DEBUG nova.objects.instance [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'flavor' on Instance uuid ebb36f74-c4a3-4108-949d-1fb8918f9a8c {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:03 user nova-compute[71711]: DEBUG nova.compute.manager [req-5cad7586-ddd9-47a9-992b-47762732683f req-a9814111-8975-44c1-9b89-3feb32668cc3 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-unplugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5cad7586-ddd9-47a9-992b-47762732683f req-a9814111-8975-44c1-9b89-3feb32668cc3 service nova] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5cad7586-ddd9-47a9-992b-47762732683f req-a9814111-8975-44c1-9b89-3feb32668cc3 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5cad7586-ddd9-47a9-992b-47762732683f req-a9814111-8975-44c1-9b89-3feb32668cc3 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:03 user nova-compute[71711]: DEBUG nova.compute.manager [req-5cad7586-ddd9-47a9-992b-47762732683f req-a9814111-8975-44c1-9b89-3feb32668cc3 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] No waiting events found dispatching network-vif-unplugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:03 user nova-compute[71711]: WARNING nova.compute.manager [req-5cad7586-ddd9-47a9-992b-47762732683f req-a9814111-8975-44c1-9b89-3feb32668cc3 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received unexpected event network-vif-unplugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:33:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:04 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Instance destroyed successfully.
Apr 12 06:33:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] No waiting events found dispatching network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:05 user nova-compute[71711]: WARNING nova.compute.manager [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received unexpected event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:33:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] No waiting events found dispatching network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:05 user nova-compute[71711]: WARNING nova.compute.manager [req-9892a94c-b43a-453b-90ff-6877e1623fec req-09d6d9a4-a799-40cf-8551-7b04dd080ed3 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received unexpected event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:33:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for ebb36f74-c4a3-4108-949d-1fb8918f9a8c due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:33:07 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281187.4996529, ebb36f74-c4a3-4108-949d-1fb8918f9a8c => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:33:07 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] VM Resumed (Lifecycle Event)
Apr 12 06:33:07 user nova-compute[71711]: DEBUG nova.compute.manager [None req-93d1c294-8cf6-45da-a043-a4c4236e5de3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:33:07 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:33:07 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:33:07 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 06:33:07 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281187.5007637, ebb36f74-c4a3-4108-949d-1fb8918f9a8c => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:33:07 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] VM Started (Lifecycle Event)
Apr 12 06:33:07 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:33:07 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:33:07 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3d51d37-c354-4a25-904f-1cbc28d8af43 req-c00a2028-3ea8-4e9a-b21d-afb70db2b26b service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:07 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3d51d37-c354-4a25-904f-1cbc28d8af43 req-c00a2028-3ea8-4e9a-b21d-afb70db2b26b service nova] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:07 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3d51d37-c354-4a25-904f-1cbc28d8af43 req-c00a2028-3ea8-4e9a-b21d-afb70db2b26b service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:07 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3d51d37-c354-4a25-904f-1cbc28d8af43 req-c00a2028-3ea8-4e9a-b21d-afb70db2b26b service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:07 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3d51d37-c354-4a25-904f-1cbc28d8af43 req-c00a2028-3ea8-4e9a-b21d-afb70db2b26b service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] No waiting events found dispatching network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:07 user nova-compute[71711]: WARNING nova.compute.manager [req-e3d51d37-c354-4a25-904f-1cbc28d8af43 req-c00a2028-3ea8-4e9a-b21d-afb70db2b26b service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received unexpected event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance with vm_state active and task_state None.
Apr 12 06:33:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:10 user nova-compute[71711]: INFO nova.compute.manager [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Rescuing
Apr 12 06:33:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:33:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquired lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:33:10 user nova-compute[71711]: DEBUG nova.network.neutron [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:33:10 user nova-compute[71711]: DEBUG nova.network.neutron [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Updating instance_info_cache with network_info: [{"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:33:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Releasing lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:33:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-355705b1-86ed-413b-95c7-88fb49dc754c req-6da8baa6-9f5b-4b02-af58-df4c85f1ed7d service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-unplugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-355705b1-86ed-413b-95c7-88fb49dc754c req-6da8baa6-9f5b-4b02-af58-df4c85f1ed7d service nova] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-355705b1-86ed-413b-95c7-88fb49dc754c req-6da8baa6-9f5b-4b02-af58-df4c85f1ed7d service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-355705b1-86ed-413b-95c7-88fb49dc754c req-6da8baa6-9f5b-4b02-af58-df4c85f1ed7d service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-355705b1-86ed-413b-95c7-88fb49dc754c req-6da8baa6-9f5b-4b02-af58-df4c85f1ed7d service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] No waiting events found dispatching network-vif-unplugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:10 user nova-compute[71711]: WARNING nova.compute.manager [req-355705b1-86ed-413b-95c7-88fb49dc754c req-6da8baa6-9f5b-4b02-af58-df4c85f1ed7d service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received unexpected event network-vif-unplugged-92e5c952-1e00-4dde-8dcc-dc876149d896 for instance with vm_state active and task_state rescuing.
Apr 12 06:33:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:11 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Instance destroyed successfully.
Apr 12 06:33:11 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Attempting rescue
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71711) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Instance directory exists: not creating {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 06:33:11 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Creating image(s)
Apr 12 06:33:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "/opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "/opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "/opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.objects.instance [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5364688b-cc08-4407-94f5-974846ae7bb8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.rescue {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.rescue" returned: 0 in 0.060s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.objects.instance [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'migration_context' on Instance uuid 5364688b-cc08-4407-94f5-974846ae7bb8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Start _get_guest_xml network_info=[{"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "vif_mac": "fa:16:3e:42:29:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.objects.instance [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'resources' on Instance uuid 5364688b-cc08-4407-94f5-974846ae7bb8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.objects.instance [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'numa_topology' on Instance uuid 5364688b-cc08-4407-94f5-974846ae7bb8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:11 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:33:11 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.objects.instance [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5364688b-cc08-4407-94f5-974846ae7bb8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-457399220',display_name='tempest-ServerRescueNegativeTestJSON-server-457399220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-457399220',id=17,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:28:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='972842dc32ee4687866dfe2fbefe9cb4',ramdisk_id='',reservation_id='r-042stp6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1179647693',owner_user_name='tempest-ServerRescueNegativeTestJSON-1179647693-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:28:35Z,user_data=None,user_id='dc8e6af1db834409a4880040a5ef6a5a',uuid=5364688b-cc08-4407-94f5-974846ae7bb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "vif_mac": "fa:16:3e:42:29:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converting VIF {"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "vif_mac": "fa:16:3e:42:29:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=92e5c952-1e00-4dde-8dcc-dc876149d896,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e5c952-1e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.objects.instance [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'pci_devices' on Instance uuid 5364688b-cc08-4407-94f5-974846ae7bb8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:33:11 user nova-compute[71711]:   <uuid>5364688b-cc08-4407-94f5-974846ae7bb8</uuid>
Apr 12 06:33:11 user nova-compute[71711]:   <name>instance-00000011</name>
Apr 12 06:33:11 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:33:11 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:33:11 user nova-compute[71711]:   <metadata>
Apr 12 06:33:11 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:33:11 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:33:11 user nova-compute[71711]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-457399220</nova:name>
Apr 12 06:33:11 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:33:11</nova:creationTime>
Apr 12 06:33:11 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:33:11 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:33:11 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:33:11 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:33:11 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:33:11 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:33:11 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:33:11 user nova-compute[71711]:       <nova:owner>
Apr 12 06:33:11 user nova-compute[71711]:         <nova:user uuid="dc8e6af1db834409a4880040a5ef6a5a">tempest-ServerRescueNegativeTestJSON-1179647693-project-member</nova:user>
Apr 12 06:33:11 user nova-compute[71711]:         <nova:project uuid="972842dc32ee4687866dfe2fbefe9cb4">tempest-ServerRescueNegativeTestJSON-1179647693</nova:project>
Apr 12 06:33:11 user nova-compute[71711]:       </nova:owner>
Apr 12 06:33:11 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:33:11 user nova-compute[71711]:       <nova:ports>
Apr 12 06:33:11 user nova-compute[71711]:         <nova:port uuid="92e5c952-1e00-4dde-8dcc-dc876149d896">
Apr 12 06:33:11 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 06:33:11 user nova-compute[71711]:         </nova:port>
Apr 12 06:33:11 user nova-compute[71711]:       </nova:ports>
Apr 12 06:33:11 user nova-compute[71711]:     </nova:instance>
Apr 12 06:33:11 user nova-compute[71711]:   </metadata>
Apr 12 06:33:11 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:33:11 user nova-compute[71711]:     <system>
Apr 12 06:33:11 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:33:11 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:33:11 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:33:11 user nova-compute[71711]:       <entry name="serial">5364688b-cc08-4407-94f5-974846ae7bb8</entry>
Apr 12 06:33:11 user nova-compute[71711]:       <entry name="uuid">5364688b-cc08-4407-94f5-974846ae7bb8</entry>
Apr 12 06:33:11 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:33:11 user nova-compute[71711]:     </system>
Apr 12 06:33:11 user nova-compute[71711]:   </sysinfo>
Apr 12 06:33:11 user nova-compute[71711]:   <os>
Apr 12 06:33:11 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:33:11 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:33:11 user nova-compute[71711]:   </os>
Apr 12 06:33:11 user nova-compute[71711]:   <features>
Apr 12 06:33:11 user nova-compute[71711]:     <acpi/>
Apr 12 06:33:11 user nova-compute[71711]:     <apic/>
Apr 12 06:33:11 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:33:11 user nova-compute[71711]:   </features>
Apr 12 06:33:11 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:33:11 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:33:11 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:33:11 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:33:11 user nova-compute[71711]:   </clock>
Apr 12 06:33:11 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:33:11 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:33:11 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:33:11 user nova-compute[71711]:   </cpu>
Apr 12 06:33:11 user nova-compute[71711]:   <devices>
Apr 12 06:33:11 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:33:11 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:33:11 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.rescue"/>
Apr 12 06:33:11 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:33:11 user nova-compute[71711]:     </disk>
Apr 12 06:33:11 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:33:11 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:33:11 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk"/>
Apr 12 06:33:11 user nova-compute[71711]:       <target dev="vdb" bus="virtio"/>
Apr 12 06:33:11 user nova-compute[71711]:     </disk>
Apr 12 06:33:11 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:33:11 user nova-compute[71711]:       <mac address="fa:16:3e:42:29:c8"/>
Apr 12 06:33:11 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:33:11 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:33:11 user nova-compute[71711]:       <target dev="tap92e5c952-1e"/>
Apr 12 06:33:11 user nova-compute[71711]:     </interface>
Apr 12 06:33:11 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:33:11 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/console.log" append="off"/>
Apr 12 06:33:11 user nova-compute[71711]:     </serial>
Apr 12 06:33:11 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:33:11 user nova-compute[71711]:     <video>
Apr 12 06:33:11 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:33:11 user nova-compute[71711]:     </video>
Apr 12 06:33:11 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:33:11 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:33:11 user nova-compute[71711]:     </rng>
Apr 12 06:33:11 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:33:11 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:33:11 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:33:11 user nova-compute[71711]:     </memballoon>
Apr 12 06:33:11 user nova-compute[71711]:   </devices>
Apr 12 06:33:11 user nova-compute[71711]: </domain>
Apr 12 06:33:11 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:33:11 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Instance destroyed successfully.
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:33:11 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No VIF found with MAC fa:16:3e:42:29:c8, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:33:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-8a51134e-0bc0-4bdd-b501-2bc8d14cf198 req-b62a230c-ae66-45ed-8e5d-5931340dfd2e service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8a51134e-0bc0-4bdd-b501-2bc8d14cf198 req-b62a230c-ae66-45ed-8e5d-5931340dfd2e service nova] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8a51134e-0bc0-4bdd-b501-2bc8d14cf198 req-b62a230c-ae66-45ed-8e5d-5931340dfd2e service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8a51134e-0bc0-4bdd-b501-2bc8d14cf198 req-b62a230c-ae66-45ed-8e5d-5931340dfd2e service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-8a51134e-0bc0-4bdd-b501-2bc8d14cf198 req-b62a230c-ae66-45ed-8e5d-5931340dfd2e service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] No waiting events found dispatching network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:12 user nova-compute[71711]: WARNING nova.compute.manager [req-8a51134e-0bc0-4bdd-b501-2bc8d14cf198 req-b62a230c-ae66-45ed-8e5d-5931340dfd2e service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received unexpected event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 for instance with vm_state active and task_state rescuing.
Apr 12 06:33:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Received event network-changed-d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Refreshing instance network info cache due to event network-changed-d754ac1a-af83-49a7-8476-727172ee88b1. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:33:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] Acquiring lock "refresh_cache-cb572c1a-2901-4b09-920d-e3e0da7765b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:33:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] Acquired lock "refresh_cache-cb572c1a-2901-4b09-920d-e3e0da7765b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:33:13 user nova-compute[71711]: DEBUG nova.network.neutron [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Refreshing network info cache for port d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:33:13 user nova-compute[71711]: DEBUG nova.network.neutron [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Updated VIF entry in instance network info cache for port d754ac1a-af83-49a7-8476-727172ee88b1. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:33:13 user nova-compute[71711]: DEBUG nova.network.neutron [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Updating instance_info_cache with network_info: [{"id": "d754ac1a-af83-49a7-8476-727172ee88b1", "address": "fa:16:3e:94:49:68", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd754ac1a-af", "ovs_interfaceid": "d754ac1a-af83-49a7-8476-727172ee88b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:33:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2e9e7b5f-e9ca-4d2b-b2a9-a71a9a8435df req-4ebd9589-32a1-4a61-983f-fb397b9a3700 service nova] Releasing lock "refresh_cache-cb572c1a-2901-4b09-920d-e3e0da7765b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG nova.objects.instance [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'flavor' on Instance uuid cb572c1a-2901-4b09-920d-e3e0da7765b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] No waiting events found dispatching network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:14 user nova-compute[71711]: WARNING nova.compute.manager [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received unexpected event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 for instance with vm_state active and task_state rescuing.
Apr 12 06:33:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] No waiting events found dispatching network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:14 user nova-compute[71711]: WARNING nova.compute.manager [req-ce79b3b7-e062-4f24-859e-a81e8a96efbc req-9f5fa3d6-10d8-4af8-a17b-24caea47dfb7 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received unexpected event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 for instance with vm_state active and task_state rescuing.
Apr 12 06:33:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:14 user nova-compute[71711]: INFO nova.compute.manager [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Attaching volume 7604ff57-70fb-4c5c-abde-c58dab75bf44 to /dev/vdb
Apr 12 06:33:15 user nova-compute[71711]: DEBUG os_brick.utils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dac2f44-49a3-4aba-9fde-c32731aa8e1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcb5dff-03b7-48f8-b812-decbc69c81be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bbb4d9-5c49-48c5-85ca-9f4178b84c22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f9b49f-cb71-4178-9afd-199befec6d8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:33:15 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:33:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[770eab2a-2332-4532-ace9-8e2a8ad20692]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG os_brick.utils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Updating existing volume attachment record: 00973a61-0443-4ebe-9af3-e328e59f2c74 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for 5364688b-cc08-4407-94f5-974846ae7bb8 due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281195.2222435, 5364688b-cc08-4407-94f5-974846ae7bb8 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:33:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] VM Resumed (Lifecycle Event)
Apr 12 06:33:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-685eb32e-bb18-4f9c-9f91-6fd8ea43b30a tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:33:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 06:33:15 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281195.224915, 5364688b-cc08-4407-94f5-974846ae7bb8 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:33:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] VM Started (Lifecycle Event)
Apr 12 06:33:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:33:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:33:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwscbTLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:33:19 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:33:19 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:33:19 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[becfd506-2ff7-4870-9820-c2349e8f1911]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:33:19 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3213d33e-3fa5-4cf9-a567-710f00c8aa7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44] added
Apr 12 06:33:19 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74a212a-6c59-4209-9596-17b1340e044a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6988b3-7c29-4a38-b43e-d55272d15fe2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SwscbTLM {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SwscbTLM" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a6f200-c4ae-47a1-9d89-42dd3e71e172]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SwscbTLM'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba266cd-68ac-43c6-b0ba-e9ba599a7aba]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f714cf1-e61e-48df-ac55-2986592f2457]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:33:19 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:33:19 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:33:19 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:33:19 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c59cfbc-6ae0-4014-b6c8-008154e790a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44, portal: 172.16.0.220,3260]
Apr 12 06:33:19 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44, portal: 172.16.0.220,3260] successful.
Apr 12 06:33:19 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0db743a-e70f-43bc-8066-9833b99c1aa2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca7a1c5-b750-4274-aa9a-3e0ca8ae3b02]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:33:19 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:33:19 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:33:19 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:33:19 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:33:19 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:33:19 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[225d2efe-ac43-436f-8e8b-86fb83c42bc2]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:33:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwscbTLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:33:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:33:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23462623366343864', 'path': '/dev/sdc'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:33:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462623366343864', 'path': '/dev/sdc'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:33:20 user nova-compute[71711]: DEBUG nova.objects.instance [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'flavor' on Instance uuid cb572c1a-2901-4b09-920d-e3e0da7765b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:33:20 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:33:20 user nova-compute[71711]:   <source dev="/dev/sdc"/>
Apr 12 06:33:20 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:33:20 user nova-compute[71711]:   <serial>7604ff57-70fb-4c5c-abde-c58dab75bf44</serial>
Apr 12 06:33:20 user nova-compute[71711]: </disk>
Apr 12 06:33:20 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:33:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:33:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:33:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No VIF found with MAC fa:16:3e:94:49:68, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:33:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c30ccbcd-877b-4a51-9724-216e654931b7 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.497s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:25 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:33:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:33:25 user nova-compute[71711]: INFO nova.compute.claims [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Claim successful on node user
Apr 12 06:33:26 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:33:26 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:33:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG nova.policy [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:33:26 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Creating image(s)
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "/opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "/opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "/opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.162s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.152s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk 1073741824" returned: 0 in 0.061s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:33:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Cannot resize image /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'migration_context' on Instance uuid 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Ensure instance console log exists: /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Successfully created port: e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Successfully updated port: e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "refresh_cache-143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquired lock "refresh_cache-143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Received event network-changed-e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Refreshing instance network info cache due to event network-changed-e46a4182-23c8-4fd1-9440-cdac8b154ac3. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] Acquiring lock "refresh_cache-143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:33:27 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Updating instance_info_cache with network_info: [{"id": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "address": "fa:16:3e:86:38:75", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46a4182-23", "ovs_interfaceid": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Releasing lock "refresh_cache-143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Instance network_info: |[{"id": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "address": "fa:16:3e:86:38:75", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46a4182-23", "ovs_interfaceid": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] Acquired lock "refresh_cache-143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.network.neutron [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Refreshing network info cache for port e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Start _get_guest_xml network_info=[{"id": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "address": "fa:16:3e:86:38:75", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46a4182-23", "ovs_interfaceid": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:33:28 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:33:28 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-945949060',display_name='tempest-AttachVolumeNegativeTest-server-945949060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-945949060',id=26,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNwlM6zSnkK1jad1V9qKi524+E4rmQa144JesydPzqH82Ovc0LOKIywWpQOwMA7pWSHkpAa5K56dCsv1Gsc/gnYUBqF08xTKKJ5aK4Ulo5NbEwkjx1hIBc1S3H5NYx0MQ==',key_name='tempest-keypair-1092224738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b267dce1303d451ca307eeaa38baf685',ramdisk_id='',reservation_id='r-gxpxa80r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1905486920',owner_user_name='tempest-AttachVolumeNegativeTest-1905486920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:33:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',uuid=143e1e28-20bd-4cdc-b9e4-c199a3d42e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "address": "fa:16:3e:86:38:75", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46a4182-23", "ovs_interfaceid": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converting VIF {"id": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "address": "fa:16:3e:86:38:75", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46a4182-23", "ovs_interfaceid": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:38:75,bridge_name='br-int',has_traffic_filtering=True,id=e46a4182-23c8-4fd1-9440-cdac8b154ac3,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46a4182-23') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'pci_devices' on Instance uuid 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:33:28 user nova-compute[71711]:   <uuid>143e1e28-20bd-4cdc-b9e4-c199a3d42e3c</uuid>
Apr 12 06:33:28 user nova-compute[71711]:   <name>instance-0000001a</name>
Apr 12 06:33:28 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:33:28 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:33:28 user nova-compute[71711]:   <metadata>
Apr 12 06:33:28 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:33:28 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:33:28 user nova-compute[71711]:       <nova:name>tempest-AttachVolumeNegativeTest-server-945949060</nova:name>
Apr 12 06:33:28 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:33:28</nova:creationTime>
Apr 12 06:33:28 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:33:28 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:33:28 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:33:28 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:33:28 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:33:28 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:33:28 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:33:28 user nova-compute[71711]:       <nova:owner>
Apr 12 06:33:28 user nova-compute[71711]:         <nova:user uuid="d6cd1f8b3c0d42298f6f4a303f1251ec">tempest-AttachVolumeNegativeTest-1905486920-project-member</nova:user>
Apr 12 06:33:28 user nova-compute[71711]:         <nova:project uuid="b267dce1303d451ca307eeaa38baf685">tempest-AttachVolumeNegativeTest-1905486920</nova:project>
Apr 12 06:33:28 user nova-compute[71711]:       </nova:owner>
Apr 12 06:33:28 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:33:28 user nova-compute[71711]:       <nova:ports>
Apr 12 06:33:28 user nova-compute[71711]:         <nova:port uuid="e46a4182-23c8-4fd1-9440-cdac8b154ac3">
Apr 12 06:33:28 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 06:33:28 user nova-compute[71711]:         </nova:port>
Apr 12 06:33:28 user nova-compute[71711]:       </nova:ports>
Apr 12 06:33:28 user nova-compute[71711]:     </nova:instance>
Apr 12 06:33:28 user nova-compute[71711]:   </metadata>
Apr 12 06:33:28 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:33:28 user nova-compute[71711]:     <system>
Apr 12 06:33:28 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:33:28 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:33:28 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:33:28 user nova-compute[71711]:       <entry name="serial">143e1e28-20bd-4cdc-b9e4-c199a3d42e3c</entry>
Apr 12 06:33:28 user nova-compute[71711]:       <entry name="uuid">143e1e28-20bd-4cdc-b9e4-c199a3d42e3c</entry>
Apr 12 06:33:28 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:33:28 user nova-compute[71711]:     </system>
Apr 12 06:33:28 user nova-compute[71711]:   </sysinfo>
Apr 12 06:33:28 user nova-compute[71711]:   <os>
Apr 12 06:33:28 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:33:28 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:33:28 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:33:28 user nova-compute[71711]:   </os>
Apr 12 06:33:28 user nova-compute[71711]:   <features>
Apr 12 06:33:28 user nova-compute[71711]:     <acpi/>
Apr 12 06:33:28 user nova-compute[71711]:     <apic/>
Apr 12 06:33:28 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:33:28 user nova-compute[71711]:   </features>
Apr 12 06:33:28 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:33:28 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:33:28 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:33:28 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:33:28 user nova-compute[71711]:   </clock>
Apr 12 06:33:28 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:33:28 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:33:28 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:33:28 user nova-compute[71711]:   </cpu>
Apr 12 06:33:28 user nova-compute[71711]:   <devices>
Apr 12 06:33:28 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:33:28 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:33:28 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk"/>
Apr 12 06:33:28 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:33:28 user nova-compute[71711]:     </disk>
Apr 12 06:33:28 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:33:28 user nova-compute[71711]:       <mac address="fa:16:3e:86:38:75"/>
Apr 12 06:33:28 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:33:28 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:33:28 user nova-compute[71711]:       <target dev="tape46a4182-23"/>
Apr 12 06:33:28 user nova-compute[71711]:     </interface>
Apr 12 06:33:28 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:33:28 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/console.log" append="off"/>
Apr 12 06:33:28 user nova-compute[71711]:     </serial>
Apr 12 06:33:28 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:33:28 user nova-compute[71711]:     <video>
Apr 12 06:33:28 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:33:28 user nova-compute[71711]:     </video>
Apr 12 06:33:28 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:33:28 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:33:28 user nova-compute[71711]:     </rng>
Apr 12 06:33:28 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:33:28 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:33:28 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:33:28 user nova-compute[71711]:     </memballoon>
Apr 12 06:33:28 user nova-compute[71711]:   </devices>
Apr 12 06:33:28 user nova-compute[71711]: </domain>
Apr 12 06:33:28 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-945949060',display_name='tempest-AttachVolumeNegativeTest-server-945949060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-945949060',id=26,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNwlM6zSnkK1jad1V9qKi524+E4rmQa144JesydPzqH82Ovc0LOKIywWpQOwMA7pWSHkpAa5K56dCsv1Gsc/gnYUBqF08xTKKJ5aK4Ulo5NbEwkjx1hIBc1S3H5NYx0MQ==',key_name='tempest-keypair-1092224738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b267dce1303d451ca307eeaa38baf685',ramdisk_id='',reservation_id='r-gxpxa80r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1905486920',owner_user_name='tempest-AttachVolumeNegativeTest-1905486920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:33:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',uuid=143e1e28-20bd-4cdc-b9e4-c199a3d42e3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "address": "fa:16:3e:86:38:75", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46a4182-23", "ovs_interfaceid": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converting VIF {"id": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "address": "fa:16:3e:86:38:75", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46a4182-23", "ovs_interfaceid": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:38:75,bridge_name='br-int',has_traffic_filtering=True,id=e46a4182-23c8-4fd1-9440-cdac8b154ac3,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46a4182-23') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG os_vif [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:38:75,bridge_name='br-int',has_traffic_filtering=True,id=e46a4182-23c8-4fd1-9440-cdac8b154ac3,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46a4182-23') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape46a4182-23, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape46a4182-23, col_values=(('external_ids', {'iface-id': 'e46a4182-23c8-4fd1-9440-cdac8b154ac3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:38:75', 'vm-uuid': '143e1e28-20bd-4cdc-b9e4-c199a3d42e3c'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:28 user nova-compute[71711]: INFO os_vif [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:38:75,bridge_name='br-int',has_traffic_filtering=True,id=e46a4182-23c8-4fd1-9440-cdac8b154ac3,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46a4182-23')
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No VIF found with MAC fa:16:3e:86:38:75, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.network.neutron [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Updated VIF entry in instance network info cache for port e46a4182-23c8-4fd1-9440-cdac8b154ac3. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG nova.network.neutron [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Updating instance_info_cache with network_info: [{"id": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "address": "fa:16:3e:86:38:75", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46a4182-23", "ovs_interfaceid": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:33:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3daf8fae-5276-4efe-b373-4089fc7aa072 req-d66fd3d1-a0c5-49ef-9b8f-1368b2c3197d service nova] Releasing lock "refresh_cache-143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:33:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:30 user nova-compute[71711]: DEBUG nova.compute.manager [req-32b7a6bf-ce52-4166-b1aa-1bcf43988d95 req-085999ca-f54f-44e3-b7d7-b69dc04b10ce service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Received event network-vif-plugged-e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-32b7a6bf-ce52-4166-b1aa-1bcf43988d95 req-085999ca-f54f-44e3-b7d7-b69dc04b10ce service nova] Acquiring lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-32b7a6bf-ce52-4166-b1aa-1bcf43988d95 req-085999ca-f54f-44e3-b7d7-b69dc04b10ce service nova] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-32b7a6bf-ce52-4166-b1aa-1bcf43988d95 req-085999ca-f54f-44e3-b7d7-b69dc04b10ce service nova] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:30 user nova-compute[71711]: DEBUG nova.compute.manager [req-32b7a6bf-ce52-4166-b1aa-1bcf43988d95 req-085999ca-f54f-44e3-b7d7-b69dc04b10ce service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] No waiting events found dispatching network-vif-plugged-e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:30 user nova-compute[71711]: WARNING nova.compute.manager [req-32b7a6bf-ce52-4166-b1aa-1bcf43988d95 req-085999ca-f54f-44e3-b7d7-b69dc04b10ce service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Received unexpected event network-vif-plugged-e46a4182-23c8-4fd1-9440-cdac8b154ac3 for instance with vm_state building and task_state spawning.
Apr 12 06:33:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281211.861257, 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:33:31 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] VM Resumed (Lifecycle Event)
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:33:31 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Instance spawned successfully.
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:33:31 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281211.862497, 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:33:31 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] VM Started (Lifecycle Event)
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:33:31 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:33:31 user nova-compute[71711]: INFO nova.compute.manager [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Took 5.63 seconds to spawn the instance on the hypervisor.
Apr 12 06:33:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:33:32 user nova-compute[71711]: INFO nova.compute.manager [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Took 6.42 seconds to build instance.
Apr 12 06:33:32 user nova-compute[71711]: DEBUG nova.compute.manager [req-e28fde92-8210-47d7-9718-b9c631f86eff req-8926f919-42e6-41cf-b1e0-24a699790636 service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Received event network-vif-plugged-e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e28fde92-8210-47d7-9718-b9c631f86eff req-8926f919-42e6-41cf-b1e0-24a699790636 service nova] Acquiring lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e28fde92-8210-47d7-9718-b9c631f86eff req-8926f919-42e6-41cf-b1e0-24a699790636 service nova] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e28fde92-8210-47d7-9718-b9c631f86eff req-8926f919-42e6-41cf-b1e0-24a699790636 service nova] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:32 user nova-compute[71711]: DEBUG nova.compute.manager [req-e28fde92-8210-47d7-9718-b9c631f86eff req-8926f919-42e6-41cf-b1e0-24a699790636 service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] No waiting events found dispatching network-vif-plugged-e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:32 user nova-compute[71711]: WARNING nova.compute.manager [req-e28fde92-8210-47d7-9718-b9c631f86eff req-8926f919-42e6-41cf-b1e0-24a699790636 service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Received unexpected event network-vif-plugged-e46a4182-23c8-4fd1-9440-cdac8b154ac3 for instance with vm_state active and task_state None.
Apr 12 06:33:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1a2ed036-3846-4e44-96ad-16d7c2557bbf tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.549s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG nova.objects.instance [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'flavor' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:36 user nova-compute[71711]: INFO nova.compute.manager [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Attaching volume 1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 to /dev/vdb
Apr 12 06:33:36 user nova-compute[71711]: DEBUG os_brick.utils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1756f236-f5f8-41da-807a-7e0469b7d312]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[62899fa8-9999-4fda-9364-b76112d78a34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aecdc5a-c489-46b8-a40b-af032c31f192]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ba9fbc-597f-4346-b731-b02b969a3af5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:33:36 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:33:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d20cf5c-665f-4790-a9a6-237e54e6a27a]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG os_brick.utils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:33:36 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Updating existing volume attachment record: 59e05987-a2b8-4850-8239-a495a0a05aa9 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:33:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWDnsZuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:33:41 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:33:41 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:33:41 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8131efb2-7f92-46b4-8050-53b2070f5097]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:33:41 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb0f0b3-c635-47ca-bbe7-8a88009cc74f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8] added
Apr 12 06:33:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0368844-707c-4689-b1eb-99ef42d6c9b6]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb41bbf-cf84-437d-958b-6fa8e2bf0bd8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wWDnsZuU {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wWDnsZuU" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3181992-59ca-438c-b86f-3fbd11ad153a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wWDnsZuU'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbe14d4-b3a2-48e7-ae46-f24fb5764fc2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0171bb-1187-49f8-8beb-d61ec6b2f50a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[babe764d-1dfb-4cf8-a823-6f2ef78e17c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8, portal: 172.16.0.220,3260]
Apr 12 06:33:41 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8, portal: 172.16.0.220,3260] successful.
Apr 12 06:33:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[64547901-dc8e-4aaa-ba85-d4dbb7b1152c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d671c74c-7187-41e6-9219-b1cd29e558c4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 (non-flash)
Apr 12 06:33:41 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91c8f47-13b8-42d3-a286-32fa209a4e76]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:33:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:33:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWDnsZuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:33:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:33:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23036393161343463', 'path': '/dev/sde'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:33:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036393161343463', 'path': '/dev/sde'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:33:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'flavor' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:33:42 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:33:42 user nova-compute[71711]:   <source dev="/dev/sde"/>
Apr 12 06:33:42 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:33:42 user nova-compute[71711]:   <serial>1352a4c5-edb1-4cf3-8768-5ef649fe2bf8</serial>
Apr 12 06:33:42 user nova-compute[71711]: </disk>
Apr 12 06:33:42 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No VIF found with MAC fa:16:3e:5b:66:97, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-eb7227a6-a02a-48d9-beab-9e41c94f4df3 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.656s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "487bc635-136c-43b1-8cb2-f233a0beaa25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:43 user nova-compute[71711]: INFO nova.compute.manager [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Terminating instance
Apr 12 06:33:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-d027fe9c-0441-40d4-8d07-3ed7c12a8046 req-a41c30d1-a4f6-4adc-a860-1d28d90ea43c service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Received event network-vif-unplugged-47d2a1d0-2b44-4c97-a535-93b333238ea6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d027fe9c-0441-40d4-8d07-3ed7c12a8046 req-a41c30d1-a4f6-4adc-a860-1d28d90ea43c service nova] Acquiring lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d027fe9c-0441-40d4-8d07-3ed7c12a8046 req-a41c30d1-a4f6-4adc-a860-1d28d90ea43c service nova] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d027fe9c-0441-40d4-8d07-3ed7c12a8046 req-a41c30d1-a4f6-4adc-a860-1d28d90ea43c service nova] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-d027fe9c-0441-40d4-8d07-3ed7c12a8046 req-a41c30d1-a4f6-4adc-a860-1d28d90ea43c service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] No waiting events found dispatching network-vif-unplugged-47d2a1d0-2b44-4c97-a535-93b333238ea6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-d027fe9c-0441-40d4-8d07-3ed7c12a8046 req-a41c30d1-a4f6-4adc-a860-1d28d90ea43c service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Received event network-vif-unplugged-47d2a1d0-2b44-4c97-a535-93b333238ea6 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Instance destroyed successfully.
Apr 12 06:33:44 user nova-compute[71711]: DEBUG nova.objects.instance [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lazy-loading 'resources' on Instance uuid 487bc635-136c-43b1-8cb2-f233a0beaa25 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:31:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-166257788',display_name='tempest-VolumesActionsTest-instance-166257788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-166257788',id=24,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0a755743544f7c97644faad13bdeb4',ramdisk_id='',reservation_id='r-lcrzwgkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1914558791',owner_user_name='tempest-VolumesActionsTest-1914558791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:32:00Z,user_data=None,user_id='67fbba4b2bbc4bb3b2255ef1facd7442',uuid=487bc635-136c-43b1-8cb2-f233a0beaa25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "address": "fa:16:3e:1a:dc:5f", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d2a1d0-2b", "ovs_interfaceid": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Converting VIF {"id": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "address": "fa:16:3e:1a:dc:5f", "network": {"id": "f297c8e7-b3ac-4aa8-9a82-58dc197846a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1393040308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4d0a755743544f7c97644faad13bdeb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d2a1d0-2b", "ovs_interfaceid": "47d2a1d0-2b44-4c97-a535-93b333238ea6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:dc:5f,bridge_name='br-int',has_traffic_filtering=True,id=47d2a1d0-2b44-4c97-a535-93b333238ea6,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d2a1d0-2b') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG os_vif [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:dc:5f,bridge_name='br-int',has_traffic_filtering=True,id=47d2a1d0-2b44-4c97-a535-93b333238ea6,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d2a1d0-2b') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47d2a1d0-2b, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:33:44 user nova-compute[71711]: INFO os_vif [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:dc:5f,bridge_name='br-int',has_traffic_filtering=True,id=47d2a1d0-2b44-4c97-a535-93b333238ea6,network=Network(f297c8e7-b3ac-4aa8-9a82-58dc197846a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d2a1d0-2b')
Apr 12 06:33:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Deleting instance files /opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25_del
Apr 12 06:33:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Deletion of /opt/stack/data/nova/instances/487bc635-136c-43b1-8cb2-f233a0beaa25_del complete
Apr 12 06:33:44 user nova-compute[71711]: INFO nova.compute.manager [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Took 0.79 seconds to destroy the instance on the hypervisor.
Apr 12 06:33:44 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:44 user nova-compute[71711]: INFO nova.compute.manager [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Detaching volume 1352a4c5-edb1-4cf3-8768-5ef649fe2bf8
Apr 12 06:33:44 user nova-compute[71711]: INFO nova.virt.block_device [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Attempting to driver detach volume 1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 from mountpoint /dev/vdb
Apr 12 06:33:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Attempting to detach device vdb from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:33:44 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:33:44 user nova-compute[71711]:   <source dev="/dev/sde"/>
Apr 12 06:33:44 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:33:44 user nova-compute[71711]:   <serial>1352a4c5-edb1-4cf3-8768-5ef649fe2bf8</serial>
Apr 12 06:33:44 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:33:44 user nova-compute[71711]: </disk>
Apr 12 06:33:44 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:33:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Successfully detached device vdb from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the persistent domain config.
Apr 12 06:33:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:33:44 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:33:44 user nova-compute[71711]:   <source dev="/dev/sde"/>
Apr 12 06:33:44 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:33:44 user nova-compute[71711]:   <serial>1352a4c5-edb1-4cf3-8768-5ef649fe2bf8</serial>
Apr 12 06:33:44 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:33:44 user nova-compute[71711]: </disk>
Apr 12 06:33:44 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:33:44 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:33:45 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Took 0.50 seconds to deallocate network for instance.
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681281225.3852785, 3770a397-2124-4648-abad-d3ce6483e3b2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:33:45 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Successfully detached device vdb from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the live domain config.
Apr 12 06:33:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wWDnsZuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:33:45 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1726e978-0937-412b-8d77-8b90f6424bbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:33:45 user nova-compute[71711]: No targets found.
Apr 12 06:33:45 user nova-compute[71711]: iSNS:
Apr 12 06:33:45 user nova-compute[71711]: No targets found.
Apr 12 06:33:45 user nova-compute[71711]: STATIC:
Apr 12 06:33:45 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8
Apr 12 06:33:45 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:33:45 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:33:45 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7
Apr 12 06:33:45 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:33:45 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:33:45 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44
Apr 12 06:33:45 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:33:45 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:33:45 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:33:45 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:33:45 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:33:45 user nova-compute[71711]: FIRMWARE:
Apr 12 06:33:45 user nova-compute[71711]: No targets found.
Apr 12 06:33:45 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:33:45 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:33:45 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d64bc1-8f05-4044-b501-a093d5f925e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:45 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Deleted allocations for instance 487bc635-136c-43b1-8cb2-f233a0beaa25
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fec49b-78a6-4c60-bf23-52ad7758e788]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:33:45 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:33:45 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:33:45 user nova-compute[71711]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 (non-flash)
Apr 12 06:33:45 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:33:45 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:33:45 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:33:45 user nova-compute[71711]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 (non-flash)
Apr 12 06:33:45 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9961fd0670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8'): ({'sde'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Removing single pathed devices sde {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc6cbc8-5aac-499a-8687-e84f1c52210c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[343cbcd1-9e30-46b6-a80a-26084e24c266]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Flushing IO for device /dev/sde {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-21b043cc-8e0c-4799-b7f9-40394bac6053 tempest-VolumesActionsTest-1914558791 tempest-VolumesActionsTest-1914558791-project-member] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.824s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8765d8d6-0f41-47ab-9967-c0fa83ff26b5]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f663b-6b1f-4895-9941-4947402ebc8e]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] SCSI volumes sde have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[858d925b-8c94-419b-9fad-09baa38373f6]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1655c8a4-1bc6-4282-a205-c4e8f279e051]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8, portal: 172.16.0.220,3260]
Apr 12 06:33:45 user nova-compute[71711]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8, portal: 172.16.0.220,3260] successful.
Apr 12 06:33:45 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1352a4c5-edb1-4cf3-8768-5ef649fe2bf8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebf2de4-91f4-4812-abc5-d876ea2d64fb]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] <== disconnect_volume: return (323ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:33:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:33:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Received event network-vif-plugged-47d2a1d0-2b44-4c97-a535-93b333238ea6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] Acquiring lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] Lock "487bc635-136c-43b1-8cb2-f233a0beaa25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] No waiting events found dispatching network-vif-plugged-47d2a1d0-2b44-4c97-a535-93b333238ea6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:46 user nova-compute[71711]: WARNING nova.compute.manager [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Received unexpected event network-vif-plugged-47d2a1d0-2b44-4c97-a535-93b333238ea6 for instance with vm_state deleted and task_state None.
Apr 12 06:33:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-816224cc-c1d7-4a64-9ad1-50ab7f74f316 req-c41b6ad1-9e3f-4fc2-b607-b22e56315e17 service nova] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Received event network-vif-deleted-47d2a1d0-2b44-4c97-a535-93b333238ea6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:46 user nova-compute[71711]: DEBUG nova.objects.instance [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'flavor' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-dd9088a8-92c3-49e8-b725-7e814fa484eb tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:33:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:46 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:33:46 user nova-compute[71711]: INFO nova.compute.claims [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Claim successful on node user
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:33:47 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:33:47 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG nova.policy [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ed0f651f79846138e3be8f312b3188f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa21d19689b343dd935505ba458dd6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:33:47 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Creating image(s)
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "/opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "/opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk 1073741824" returned: 0 in 0.047s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:33:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Cannot resize image /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG nova.objects.instance [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'migration_context' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Ensure instance console log exists: /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Successfully created port: f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Successfully updated port: f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquired lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG nova.compute.manager [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-changed-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG nova.compute.manager [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Refreshing instance network info cache due to event network-changed-f90233ae-9ecb-48be-baf0-7e517849679d. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] Acquiring lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:33:48 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Updating instance_info_cache with network_info: [{"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Releasing lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Instance network_info: |[{"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] Acquired lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.network.neutron [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Refreshing network info cache for port f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Start _get_guest_xml network_info=[{"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:33:49 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:33:49 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:33:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1023741247',display_name='tempest-ServerStableDeviceRescueTest-server-1023741247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1023741247',id=27,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeOfWyak7L55BxU3CMZi8GQ9bZKqJlv/bIHJUXC8z3n705CqYiYWSJdMemQWwpBLyJE0B9ZyBbzqhcedALA6IEN7DJXMfRd9zTiTIeQNDyku00pbbHhb7qWZLZaOCMNzA==',key_name='tempest-keypair-966536347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa21d19689b343dd935505ba458dd6af',ramdisk_id='',reservation_id='r-s9xyc36m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-88660584',owner_user_name='tempest-ServerStableDeviceRescueTest-88660584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ed0f651f79846138e3be8f312b3188f',uuid=4bef2d11-2dfe-47cb-a1ed-3331038ecd99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Converting VIF {"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:90:6f,bridge_name='br-int',has_traffic_filtering=True,id=f90233ae-9ecb-48be-baf0-7e517849679d,network=Network(76d55312-0797-479f-852c-c1b78a76aa90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90233ae-9e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.objects.instance [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:33:49 user nova-compute[71711]:   <uuid>4bef2d11-2dfe-47cb-a1ed-3331038ecd99</uuid>
Apr 12 06:33:49 user nova-compute[71711]:   <name>instance-0000001b</name>
Apr 12 06:33:49 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:33:49 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:33:49 user nova-compute[71711]:   <metadata>
Apr 12 06:33:49 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:33:49 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:33:49 user nova-compute[71711]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1023741247</nova:name>
Apr 12 06:33:49 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:33:49</nova:creationTime>
Apr 12 06:33:49 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:33:49 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:33:49 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:33:49 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:33:49 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:33:49 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:33:49 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:33:49 user nova-compute[71711]:       <nova:owner>
Apr 12 06:33:49 user nova-compute[71711]:         <nova:user uuid="0ed0f651f79846138e3be8f312b3188f">tempest-ServerStableDeviceRescueTest-88660584-project-member</nova:user>
Apr 12 06:33:49 user nova-compute[71711]:         <nova:project uuid="aa21d19689b343dd935505ba458dd6af">tempest-ServerStableDeviceRescueTest-88660584</nova:project>
Apr 12 06:33:49 user nova-compute[71711]:       </nova:owner>
Apr 12 06:33:49 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:33:49 user nova-compute[71711]:       <nova:ports>
Apr 12 06:33:49 user nova-compute[71711]:         <nova:port uuid="f90233ae-9ecb-48be-baf0-7e517849679d">
Apr 12 06:33:49 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 06:33:49 user nova-compute[71711]:         </nova:port>
Apr 12 06:33:49 user nova-compute[71711]:       </nova:ports>
Apr 12 06:33:49 user nova-compute[71711]:     </nova:instance>
Apr 12 06:33:49 user nova-compute[71711]:   </metadata>
Apr 12 06:33:49 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:33:49 user nova-compute[71711]:     <system>
Apr 12 06:33:49 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:33:49 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:33:49 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:33:49 user nova-compute[71711]:       <entry name="serial">4bef2d11-2dfe-47cb-a1ed-3331038ecd99</entry>
Apr 12 06:33:49 user nova-compute[71711]:       <entry name="uuid">4bef2d11-2dfe-47cb-a1ed-3331038ecd99</entry>
Apr 12 06:33:49 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:33:49 user nova-compute[71711]:     </system>
Apr 12 06:33:49 user nova-compute[71711]:   </sysinfo>
Apr 12 06:33:49 user nova-compute[71711]:   <os>
Apr 12 06:33:49 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:33:49 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:33:49 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:33:49 user nova-compute[71711]:   </os>
Apr 12 06:33:49 user nova-compute[71711]:   <features>
Apr 12 06:33:49 user nova-compute[71711]:     <acpi/>
Apr 12 06:33:49 user nova-compute[71711]:     <apic/>
Apr 12 06:33:49 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:33:49 user nova-compute[71711]:   </features>
Apr 12 06:33:49 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:33:49 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:33:49 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:33:49 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:33:49 user nova-compute[71711]:   </clock>
Apr 12 06:33:49 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:33:49 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:33:49 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:33:49 user nova-compute[71711]:   </cpu>
Apr 12 06:33:49 user nova-compute[71711]:   <devices>
Apr 12 06:33:49 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:33:49 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:33:49 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk"/>
Apr 12 06:33:49 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:33:49 user nova-compute[71711]:     </disk>
Apr 12 06:33:49 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:33:49 user nova-compute[71711]:       <mac address="fa:16:3e:ba:90:6f"/>
Apr 12 06:33:49 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:33:49 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:33:49 user nova-compute[71711]:       <target dev="tapf90233ae-9e"/>
Apr 12 06:33:49 user nova-compute[71711]:     </interface>
Apr 12 06:33:49 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:33:49 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/console.log" append="off"/>
Apr 12 06:33:49 user nova-compute[71711]:     </serial>
Apr 12 06:33:49 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:33:49 user nova-compute[71711]:     <video>
Apr 12 06:33:49 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:33:49 user nova-compute[71711]:     </video>
Apr 12 06:33:49 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:33:49 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:33:49 user nova-compute[71711]:     </rng>
Apr 12 06:33:49 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:33:49 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:33:49 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:33:49 user nova-compute[71711]:     </memballoon>
Apr 12 06:33:49 user nova-compute[71711]:   </devices>
Apr 12 06:33:49 user nova-compute[71711]: </domain>
Apr 12 06:33:49 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:33:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1023741247',display_name='tempest-ServerStableDeviceRescueTest-server-1023741247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1023741247',id=27,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeOfWyak7L55BxU3CMZi8GQ9bZKqJlv/bIHJUXC8z3n705CqYiYWSJdMemQWwpBLyJE0B9ZyBbzqhcedALA6IEN7DJXMfRd9zTiTIeQNDyku00pbbHhb7qWZLZaOCMNzA==',key_name='tempest-keypair-966536347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa21d19689b343dd935505ba458dd6af',ramdisk_id='',reservation_id='r-s9xyc36m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-88660584',owner_user_name='tempest-ServerStableDeviceRescueTest-88660584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ed0f651f79846138e3be8f312b3188f',uuid=4bef2d11-2dfe-47cb-a1ed-3331038ecd99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Converting VIF {"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:90:6f,bridge_name='br-int',has_traffic_filtering=True,id=f90233ae-9ecb-48be-baf0-7e517849679d,network=Network(76d55312-0797-479f-852c-c1b78a76aa90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90233ae-9e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG os_vif [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:90:6f,bridge_name='br-int',has_traffic_filtering=True,id=f90233ae-9ecb-48be-baf0-7e517849679d,network=Network(76d55312-0797-479f-852c-c1b78a76aa90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90233ae-9e') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf90233ae-9e, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf90233ae-9e, col_values=(('external_ids', {'iface-id': 'f90233ae-9ecb-48be-baf0-7e517849679d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:90:6f', 'vm-uuid': '4bef2d11-2dfe-47cb-a1ed-3331038ecd99'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:49 user nova-compute[71711]: INFO os_vif [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:90:6f,bridge_name='br-int',has_traffic_filtering=True,id=f90233ae-9ecb-48be-baf0-7e517849679d,network=Network(76d55312-0797-479f-852c-c1b78a76aa90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90233ae-9e')
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] No VIF found with MAC fa:16:3e:ba:90:6f, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG nova.network.neutron [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Updated VIF entry in instance network info cache for port f90233ae-9ecb-48be-baf0-7e517849679d. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG nova.network.neutron [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Updating instance_info_cache with network_info: [{"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-20d7dc4d-87e6-40f1-bedf-89c15416a07c req-e050bbae-d56a-4ae0-b84b-7499e3baec14 service nova] Releasing lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG nova.compute.manager [req-0d2e8b54-9df4-4b3e-99be-943f1003f685 req-841544b5-0822-4b58-bfa5-7d2cabe3b6c6 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0d2e8b54-9df4-4b3e-99be-943f1003f685 req-841544b5-0822-4b58-bfa5-7d2cabe3b6c6 service nova] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0d2e8b54-9df4-4b3e-99be-943f1003f685 req-841544b5-0822-4b58-bfa5-7d2cabe3b6c6 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0d2e8b54-9df4-4b3e-99be-943f1003f685 req-841544b5-0822-4b58-bfa5-7d2cabe3b6c6 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG nova.compute.manager [req-0d2e8b54-9df4-4b3e-99be-943f1003f685 req-841544b5-0822-4b58-bfa5-7d2cabe3b6c6 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] No waiting events found dispatching network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:51 user nova-compute[71711]: WARNING nova.compute.manager [req-0d2e8b54-9df4-4b3e-99be-943f1003f685 req-841544b5-0822-4b58-bfa5-7d2cabe3b6c6 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received unexpected event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d for instance with vm_state building and task_state spawning.
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:33:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:33:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:33:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281233.3627927, 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:33:53 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] VM Resumed (Lifecycle Event)
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-6c42203d-05c8-4a67-9619-05bd5c14dc19 req-60bb8def-a194-47d1-8349-aa18bffb9260 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6c42203d-05c8-4a67-9619-05bd5c14dc19 req-60bb8def-a194-47d1-8349-aa18bffb9260 service nova] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6c42203d-05c8-4a67-9619-05bd5c14dc19 req-60bb8def-a194-47d1-8349-aa18bffb9260 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6c42203d-05c8-4a67-9619-05bd5c14dc19 req-60bb8def-a194-47d1-8349-aa18bffb9260 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-6c42203d-05c8-4a67-9619-05bd5c14dc19 req-60bb8def-a194-47d1-8349-aa18bffb9260 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] No waiting events found dispatching network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:33:53 user nova-compute[71711]: WARNING nova.compute.manager [req-6c42203d-05c8-4a67-9619-05bd5c14dc19 req-60bb8def-a194-47d1-8349-aa18bffb9260 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received unexpected event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d for instance with vm_state building and task_state spawning.
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:33:53 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:33:53 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7687MB free_disk=26.18841552734375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:33:53 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Instance spawned successfully.
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:33:53 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281233.3637404, 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:33:53 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] VM Started (Lifecycle Event)
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:33:53 user nova-compute[71711]: INFO nova.compute.manager [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Took 6.48 seconds to spawn the instance on the hypervisor.
Apr 12 06:33:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:33:54 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 3770a397-2124-4648-abad-d3ce6483e3b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:54 user nova-compute[71711]: INFO nova.compute.manager [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Took 7.24 seconds to build instance.
Apr 12 06:33:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3ae7f3fc-6a10-4efd-92e7-5db94a9ac1e8 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.331s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.780s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:33:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:55 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:33:55 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:33:55 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:33:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:33:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:33:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:33:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Updating instance_info_cache with network_info: [{"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:33:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:33:55 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:33:55 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:33:55 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:33:55 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:33:55 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:33:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:59 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281224.3954265, 487bc635-136c-43b1-8cb2-f233a0beaa25 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:33:59 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] VM Stopped (Lifecycle Event)
Apr 12 06:33:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-8e4dedf5-42d2-4bc5-b5ba-3d92e83c5100 None None] [instance: 487bc635-136c-43b1-8cb2-f233a0beaa25] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:33:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:33:59 user nova-compute[71711]: DEBUG nova.compute.manager [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Received event network-changed-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:33:59 user nova-compute[71711]: DEBUG nova.compute.manager [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Refreshing instance network info cache due to event network-changed-0c59cad7-11ab-4be0-87a4-6e12347b4dd9. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:33:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] Acquiring lock "refresh_cache-7af3e780-e4f5-4ff6-a086-c77485d7ec67" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:33:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] Acquired lock "refresh_cache-7af3e780-e4f5-4ff6-a086-c77485d7ec67" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:33:59 user nova-compute[71711]: DEBUG nova.network.neutron [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Refreshing network info cache for port 0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:34:00 user nova-compute[71711]: DEBUG nova.network.neutron [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Updated VIF entry in instance network info cache for port 0c59cad7-11ab-4be0-87a4-6e12347b4dd9. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:34:00 user nova-compute[71711]: DEBUG nova.network.neutron [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Updating instance_info_cache with network_info: [{"id": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "address": "fa:16:3e:4d:4f:ac", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59cad7-11", "ovs_interfaceid": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:34:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f3ee1867-3540-4134-8458-8c1b4129c743 req-d2883a2c-12b9-47b9-af2d-bbccd0924e59 service nova] Releasing lock "refresh_cache-7af3e780-e4f5-4ff6-a086-c77485d7ec67" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'flavor' on Instance uuid 7af3e780-e4f5-4ff6-a086-c77485d7ec67 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:01 user nova-compute[71711]: INFO nova.compute.manager [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Attaching volume 1079c4b6-625d-4d6c-9710-702e5aa785ec to /dev/vdb
Apr 12 06:34:01 user nova-compute[71711]: DEBUG os_brick.utils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdd679f-8a68-4854-b14a-1cb9cc123361]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bc80b6-60ba-4b54-86d1-3f435cee7445]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7ee1b8-66b2-4363-95bf-24aff1903bde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6346338f-40f5-45d2-ab93-47d31bb9e4b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:34:01 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:34:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c545ec-9529-406e-bf5e-fa00d7db32ec]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG os_brick.utils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:34:01 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Updating existing volume attachment record: 1cf78530-d179-4e72-9b3a-e0c0a28a5af3 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:34:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgCbTNoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:34:06 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:34:06 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:34:06 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[658f538c-f036-4a0f-a118-7776ae8e771e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:34:06 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bc5f28-14ad-4e30-a16c-edbdf502e667]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec] added
Apr 12 06:34:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ff393c-3226-405b-8967-8e0949968ade]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[29591b28-d5a9-4d4e-b659-2370e20d87bc]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgCbTNoh {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sgCbTNoh" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed91a77b-06bf-44ae-8203-cf6d95b06b48]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sgCbTNoh'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04ee6fa-f14e-4f84-98e1-cee16046f8b9]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e206cfc2-f38b-4083-bb41-d418cc4657a5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:06 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:06 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:06 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:06 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee2a910-fdf4-494e-b270-25b984ed3ccb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec, portal: 172.16.0.220,3260]
Apr 12 06:34:06 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec, portal: 172.16.0.220,3260] successful.
Apr 12 06:34:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12903c4-4216-4ae9-a888-a63551e05837]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25b99c0-ada1-44d5-930f-e1f8e4a96c6d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:06 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:06 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:06 user nova-compute[71711]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec (non-flash)
Apr 12 06:34:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:06 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:06 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:06 user nova-compute[71711]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec (non-flash)
Apr 12 06:34:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[760030ad-454e-4f7c-bb73-563b9276b768]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:34:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgCbTNoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:34:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:34:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23638326535633933', 'path': '/dev/sde'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:34:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638326535633933', 'path': '/dev/sde'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:34:07 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'flavor' on Instance uuid 7af3e780-e4f5-4ff6-a086-c77485d7ec67 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:34:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:34:07 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:34:07 user nova-compute[71711]:   <source dev="/dev/sde"/>
Apr 12 06:34:07 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:34:07 user nova-compute[71711]:   <serial>1079c4b6-625d-4d6c-9710-702e5aa785ec</serial>
Apr 12 06:34:07 user nova-compute[71711]: </disk>
Apr 12 06:34:07 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:34:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:34:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:34:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No VIF found with MAC fa:16:3e:4d:4f:ac, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:34:07 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e09b053a-8218-4774-810b-fb94e9bb42cc tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.450s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'flavor' on Instance uuid 7af3e780-e4f5-4ff6-a086-c77485d7ec67 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:10 user nova-compute[71711]: INFO nova.compute.manager [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Attaching volume d4c733b5-a4df-4f96-8d98-ecf3eef24f50 to /dev/vdc
Apr 12 06:34:10 user nova-compute[71711]: DEBUG os_brick.utils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19b7f1b-8343-4497-b89d-18d380c658ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4da8ad-0cd3-4f20-9362-35497670c83a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1e50ea-fb0c-4fc0-8150-35e3bc493539]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4f1af6-534f-4de9-b8c4-c46119cab202]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:34:10 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:34:10 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b512b8-886d-4841-b812-839a958500ac]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG os_brick.utils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:34:10 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Updating existing volume attachment record: 9c264edb-34f6-4920-afb0-f5a937c43a2c {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:34:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMgQWNlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:34:15 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:34:15 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:34:15 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e445d0-f22e-4a63-a24a-efb2fd1b6d27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:34:15 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fdead5-a15d-470e-ac07-775cbea1c54b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50] added
Apr 12 06:34:15 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f09a28-0b51-4890-9421-0c08d381b3d8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f27b3ba-57fc-4f94-a598-62f305a1d6a7]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMgQWNlT {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMgQWNlT" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf42a5b-c517-4b87-8c76-0e2bb5bf0f18]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UMgQWNlT'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1fc0d6-b951-4242-aecc-ce2cdf5706a1]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc22350b-aff0-4645-ac4b-8b8f423b1a89]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec (non-flash)
Apr 12 06:34:15 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec (non-flash)
Apr 12 06:34:15 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9013d862-5c3a-40b7-bb83-a49ab7e59842]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50, portal: 172.16.0.220,3260]
Apr 12 06:34:15 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50, portal: 172.16.0.220,3260] successful.
Apr 12 06:34:15 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2bc736-b059-4b3c-9144-cffc5c0aee04]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5724e25-0119-43b4-a3b1-e1d4b8eeeddf]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec (non-flash)
Apr 12 06:34:15 user nova-compute[71711]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 (non-flash)
Apr 12 06:34:15 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b6ce73-5bdc-454e-9fca-74cd4f78f6c2]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:15 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:34:16 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:34:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMgQWNlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:34:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:34:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23565666637363964', 'path': '/dev/sdf'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:34:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565666637363964', 'path': '/dev/sdf'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:34:16 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'flavor' on Instance uuid 7af3e780-e4f5-4ff6-a086-c77485d7ec67 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:34:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:34:16 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:34:16 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:34:16 user nova-compute[71711]:   <target dev="vdc" bus="virtio"/>
Apr 12 06:34:16 user nova-compute[71711]:   <serial>d4c733b5-a4df-4f96-8d98-ecf3eef24f50</serial>
Apr 12 06:34:16 user nova-compute[71711]: </disk>
Apr 12 06:34:16 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:34:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:34:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:34:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:34:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] No VIF found with MAC fa:16:3e:4d:4f:ac, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:34:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e7fe8d4-de57-479a-9700-782b3233011e tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.577s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:18 user nova-compute[71711]: INFO nova.compute.manager [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Detaching volume 1079c4b6-625d-4d6c-9710-702e5aa785ec
Apr 12 06:34:18 user nova-compute[71711]: INFO nova.virt.block_device [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Attempting to driver detach volume 1079c4b6-625d-4d6c-9710-702e5aa785ec from mountpoint /dev/vdb
Apr 12 06:34:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Attempting to detach device vdb from instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:34:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:34:18 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:34:18 user nova-compute[71711]:   <source dev="/dev/sde"/>
Apr 12 06:34:18 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:34:18 user nova-compute[71711]:   <serial>1079c4b6-625d-4d6c-9710-702e5aa785ec</serial>
Apr 12 06:34:18 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:34:18 user nova-compute[71711]: </disk>
Apr 12 06:34:18 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:34:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully detached device vdb from instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 from the persistent domain config.
Apr 12 06:34:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:34:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:34:18 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:34:18 user nova-compute[71711]:   <source dev="/dev/sde"/>
Apr 12 06:34:18 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:34:18 user nova-compute[71711]:   <serial>1079c4b6-625d-4d6c-9710-702e5aa785ec</serial>
Apr 12 06:34:18 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:34:18 user nova-compute[71711]: </disk>
Apr 12 06:34:18 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681281259.1622682, 7af3e780-e4f5-4ff6-a086-c77485d7ec67 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:34:19 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully detached device vdb from instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 from the live domain config.
Apr 12 06:34:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sgCbTNoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:34:19 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d314d07-8e3c-4a13-86c2-9544acc1f429]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:34:19 user nova-compute[71711]: No targets found.
Apr 12 06:34:19 user nova-compute[71711]: iSNS:
Apr 12 06:34:19 user nova-compute[71711]: No targets found.
Apr 12 06:34:19 user nova-compute[71711]: STATIC:
Apr 12 06:34:19 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50
Apr 12 06:34:19 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:19 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:19 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7
Apr 12 06:34:19 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:19 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:19 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44
Apr 12 06:34:19 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:19 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:19 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:34:19 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:19 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:19 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec
Apr 12 06:34:19 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:19 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:19 user nova-compute[71711]: FIRMWARE:
Apr 12 06:34:19 user nova-compute[71711]: No targets found.
Apr 12 06:34:19 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:34:19 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:34:19 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cae0514-bd21-47a6-92d0-bba26010051f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fac788c-f3dc-4a68-afae-64971a5b533c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:19 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:19 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:19 user nova-compute[71711]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec (non-flash)
Apr 12 06:34:19 user nova-compute[71711]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 (non-flash)
Apr 12 06:34:19 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:19 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:19 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:19 user nova-compute[71711]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec (non-flash)
Apr 12 06:34:19 user nova-compute[71711]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 (non-flash)
Apr 12 06:34:19 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9954250160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec'): ({'sde'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Removing single pathed devices sde {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d7a55a-97e6-46cb-906f-40a89d8e7608]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9bf1d9-babe-46c7-b70c-fcd3f04c819f]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flushing IO for device /dev/sde {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[add56ee5-5bff-4e55-9a50-4a9fa6f33431]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e5f2df-ba97-4b57-bb15-e96d25ea62c7]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] SCSI volumes sde have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a93e59-9c5c-4ba1-91ae-6a6034e39c21]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[516a1e4d-82c8-451f-b0b5-13cd49856b08]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec, portal: 172.16.0.220,3260]
Apr 12 06:34:19 user nova-compute[71711]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec, portal: 172.16.0.220,3260] successful.
Apr 12 06:34:19 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1079c4b6-625d-4d6c-9710-702e5aa785ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[056764ff-519b-47ee-8487-60ab94c17df4]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] <== disconnect_volume: return (317ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:34:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:20 user nova-compute[71711]: DEBUG nova.objects.instance [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'flavor' on Instance uuid 7af3e780-e4f5-4ff6-a086-c77485d7ec67 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:34:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-08fed00f-fa5e-4d8b-aae3-f49139eb5814 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:21 user nova-compute[71711]: INFO nova.compute.manager [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Detaching volume d4c733b5-a4df-4f96-8d98-ecf3eef24f50
Apr 12 06:34:21 user nova-compute[71711]: INFO nova.virt.block_device [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Attempting to driver detach volume d4c733b5-a4df-4f96-8d98-ecf3eef24f50 from mountpoint /dev/vdc
Apr 12 06:34:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Attempting to detach device vdc from instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:34:21 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:34:21 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:34:21 user nova-compute[71711]:   <target dev="vdc" bus="virtio"/>
Apr 12 06:34:21 user nova-compute[71711]:   <serial>d4c733b5-a4df-4f96-8d98-ecf3eef24f50</serial>
Apr 12 06:34:21 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 06:34:21 user nova-compute[71711]: </disk>
Apr 12 06:34:21 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:34:21 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully detached device vdc from instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 from the persistent domain config.
Apr 12 06:34:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:34:21 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:34:21 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:34:21 user nova-compute[71711]:   <target dev="vdc" bus="virtio"/>
Apr 12 06:34:21 user nova-compute[71711]:   <serial>d4c733b5-a4df-4f96-8d98-ecf3eef24f50</serial>
Apr 12 06:34:21 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 06:34:21 user nova-compute[71711]: </disk>
Apr 12 06:34:21 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681281261.5117543, 7af3e780-e4f5-4ff6-a086-c77485d7ec67 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:34:21 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully detached device vdc from instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67 from the live domain config.
Apr 12 06:34:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMgQWNlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:34:21 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5c1864-d2a6-4bf9-877c-686aae35d977]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:34:21 user nova-compute[71711]: No targets found.
Apr 12 06:34:21 user nova-compute[71711]: iSNS:
Apr 12 06:34:21 user nova-compute[71711]: No targets found.
Apr 12 06:34:21 user nova-compute[71711]: STATIC:
Apr 12 06:34:21 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50
Apr 12 06:34:21 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:21 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:21 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7
Apr 12 06:34:21 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:21 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:21 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44
Apr 12 06:34:21 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:21 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:21 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:34:21 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:21 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:21 user nova-compute[71711]: FIRMWARE:
Apr 12 06:34:21 user nova-compute[71711]: No targets found.
Apr 12 06:34:21 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:34:21 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:34:21 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aa85e4-32a4-40be-be07-5e3b4b10c8e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c733e6-d989-4092-8cf8-08da81247c83]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:21 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:21 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:21 user nova-compute[71711]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 (non-flash)
Apr 12 06:34:21 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:21 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:21 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:21 user nova-compute[71711]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 (non-flash)
Apr 12 06:34:21 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c339750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50'): ({'sdf'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Removing single pathed devices sdf {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b5497a-4e0b-4ccb-a5da-3c55a32f8594]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ba2b46-56ed-4e08-b36f-ad3165ba5d49]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Flushing IO for device /dev/sdf {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[707867d4-66bc-4f48-a9ea-4bf6687086f7]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e9f9cc-06fa-498e-a332-c630775ed754]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c894a096-bb3e-4fe0-aac0-a4f3adafd66b]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[285c41d6-2bc9-4566-a156-fb2f714730e9]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50, portal: 172.16.0.220,3260]
Apr 12 06:34:21 user nova-compute[71711]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50, portal: 172.16.0.220,3260] successful.
Apr 12 06:34:21 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c733b5-a4df-4f96-8d98-ecf3eef24f50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b4406e-a7bc-45c7-8729-119d278b3ef3]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] <== disconnect_volume: return (299ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:34:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:34:22 user nova-compute[71711]: DEBUG nova.objects.instance [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'flavor' on Instance uuid 7af3e780-e4f5-4ff6-a086-c77485d7ec67 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:34:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-99cff04b-84fb-457e-8164-18eb6716a938 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.564s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:23 user nova-compute[71711]: INFO nova.compute.manager [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Terminating instance
Apr 12 06:34:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:34:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG nova.compute.manager [req-4b57b87b-0bdf-43a3-b6c0-b9b07cb1085d req-6951f1ed-2da0-48d0-bcb1-2003237d9578 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Received event network-vif-unplugged-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4b57b87b-0bdf-43a3-b6c0-b9b07cb1085d req-6951f1ed-2da0-48d0-bcb1-2003237d9578 service nova] Acquiring lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4b57b87b-0bdf-43a3-b6c0-b9b07cb1085d req-6951f1ed-2da0-48d0-bcb1-2003237d9578 service nova] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4b57b87b-0bdf-43a3-b6c0-b9b07cb1085d req-6951f1ed-2da0-48d0-bcb1-2003237d9578 service nova] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG nova.compute.manager [req-4b57b87b-0bdf-43a3-b6c0-b9b07cb1085d req-6951f1ed-2da0-48d0-bcb1-2003237d9578 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] No waiting events found dispatching network-vif-unplugged-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG nova.compute.manager [req-4b57b87b-0bdf-43a3-b6c0-b9b07cb1085d req-6951f1ed-2da0-48d0-bcb1-2003237d9578 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Received event network-vif-unplugged-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:34:24 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Instance destroyed successfully.
Apr 12 06:34:24 user nova-compute[71711]: DEBUG nova.objects.instance [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lazy-loading 'resources' on Instance uuid 7af3e780-e4f5-4ff6-a086-c77485d7ec67 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1012542406',display_name='tempest-AttachVolumeTestJSON-server-1012542406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1012542406',id=25,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpZmXYWicFrSyEtfpqfjfAIQY8glRt1/Lngk2QXW7mMzJ4XKM2JZgEBDcZ7pJJqIQepA9AdE8IqzBjQ9qfKnDJiYCtISr/pNtvWIW/u53rEIRJksUDTXtz1fCyVBDg34A==',key_name='tempest-keypair-2126669667',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:32:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f124d62c4d345d9af22f1557abca276',ramdisk_id='',reservation_id='r-lupdl6i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1680327736',owner_user_name='tempest-AttachVolumeTestJSON-1680327736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:32:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d58cc232d0094bebacf147c6b61a0989',uuid=7af3e780-e4f5-4ff6-a086-c77485d7ec67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "address": "fa:16:3e:4d:4f:ac", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59cad7-11", "ovs_interfaceid": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converting VIF {"id": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "address": "fa:16:3e:4d:4f:ac", "network": {"id": "8173354d-cba7-49f6-8229-6c9ee13ddb0f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1518544868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f124d62c4d345d9af22f1557abca276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c59cad7-11", "ovs_interfaceid": "0c59cad7-11ab-4be0-87a4-6e12347b4dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=0c59cad7-11ab-4be0-87a4-6e12347b4dd9,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59cad7-11') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG os_vif [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=0c59cad7-11ab-4be0-87a4-6e12347b4dd9,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59cad7-11') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c59cad7-11, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:34:24 user nova-compute[71711]: INFO os_vif [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=0c59cad7-11ab-4be0-87a4-6e12347b4dd9,network=Network(8173354d-cba7-49f6-8229-6c9ee13ddb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c59cad7-11')
Apr 12 06:34:24 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Deleting instance files /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67_del
Apr 12 06:34:24 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Deletion of /opt/stack/data/nova/instances/7af3e780-e4f5-4ff6-a086-c77485d7ec67_del complete
Apr 12 06:34:24 user nova-compute[71711]: INFO nova.compute.manager [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 12 06:34:24 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:34:24 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:34:25 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:34:25 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Took 0.94 seconds to deallocate network for instance.
Apr 12 06:34:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:25 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:34:25 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:34:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:26 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Deleted allocations for instance 7af3e780-e4f5-4ff6-a086-c77485d7ec67
Apr 12 06:34:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f7ad43b2-6ca6-4849-9bc5-aec76f934bb0 tempest-AttachVolumeTestJSON-1680327736 tempest-AttachVolumeTestJSON-1680327736-project-member] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.576s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:26 user nova-compute[71711]: DEBUG nova.compute.manager [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Received event network-vif-plugged-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:34:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] Acquiring lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] Lock "7af3e780-e4f5-4ff6-a086-c77485d7ec67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:26 user nova-compute[71711]: DEBUG nova.compute.manager [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] No waiting events found dispatching network-vif-plugged-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:34:26 user nova-compute[71711]: WARNING nova.compute.manager [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Received unexpected event network-vif-plugged-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 for instance with vm_state deleted and task_state None.
Apr 12 06:34:26 user nova-compute[71711]: DEBUG nova.compute.manager [req-ec20fae1-264d-49c5-921c-dcf1f02af3fb req-9ec775df-3bd4-4392-ae37-bd67855d9ba6 service nova] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Received event network-vif-deleted-0c59cad7-11ab-4be0-87a4-6e12347b4dd9 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:34:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'flavor' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:37 user nova-compute[71711]: INFO nova.compute.manager [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Attaching volume 06ddc1aa-31ff-4da3-b156-9b5e7f11274b to /dev/vdb
Apr 12 06:34:37 user nova-compute[71711]: DEBUG os_brick.utils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ff138c-adc2-4224-91ea-4c6711f54e82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbcac84-ec85-4b2f-90ca-5cfe1bf1cd47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2db5fa6-cfaf-48f1-a9c9-e37b30a2df88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a32b3b-6874-48f1-af08-cd5a5af4f473]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:34:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:34:38 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:34:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[68241ea8-457d-4fbd-963f-9f8eaf55394b]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:34:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:34:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:34:38 user nova-compute[71711]: DEBUG os_brick.utils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:34:38 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Updating existing volume attachment record: 98714877-d03b-465e-a81e-d5ee514df3d7 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:34:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:39 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281264.5475802, 7af3e780-e4f5-4ff6-a086-c77485d7ec67 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:34:39 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] VM Stopped (Lifecycle Event)
Apr 12 06:34:39 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b006784c-9016-4633-a98a-f2f3668fa570 None None] [instance: 7af3e780-e4f5-4ff6-a086-c77485d7ec67] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:34:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFnrsXSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:34:42 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:34:42 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:34:42 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8619ca53-8520-4c08-a18f-5ed8e3013922]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:34:42 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[50156404-30c3-424c-8087-1b1b39a8e73c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b] added
Apr 12 06:34:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ceccbf-baec-4ac4-aeec-a69076ee4c67]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f84d47-6e20-4bd2-bff9-bb3be333ee0c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFnrsXSe {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFnrsXSe" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e8f99b-217e-4b44-b293-1fb154fa9e1f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TFnrsXSe'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[448664c8-8c2c-4898-bc79-732fa2d7c4af]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f773cec3-cd95-47c8-9e21-347ea5a3450a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)
Apr 12 06:34:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)
Apr 12 06:34:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba7f5c7-01c3-460b-95c9-b3a5e09d4fc7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b, portal: 172.16.0.220,3260]
Apr 12 06:34:42 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b, portal: 172.16.0.220,3260] successful.
Apr 12 06:34:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02f6140-3b11-4835-9e2c-21e0438fb1f6]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ec5f76-e3ee-4fca-83ec-567f0cdc4b81]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b (non-flash)
Apr 12 06:34:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)
Apr 12 06:34:42 user nova-compute[71711]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b (non-flash)
Apr 12 06:34:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[743b9d14-b022-447b-80ff-82f36af6c23c]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:34:43 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:34:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFnrsXSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:34:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:34:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23865613331636130', 'path': '/dev/sdf'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:34:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865613331636130', 'path': '/dev/sdf'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:34:43 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'flavor' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:34:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:34:43 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:34:43 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:34:43 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:34:43 user nova-compute[71711]:   <serial>06ddc1aa-31ff-4da3-b156-9b5e7f11274b</serial>
Apr 12 06:34:43 user nova-compute[71711]: </disk>
Apr 12 06:34:43 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:34:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:34:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:34:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No VIF found with MAC fa:16:3e:5b:66:97, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:34:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e7f4477-d9dc-4fba-9f40-6fea68258299 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.342s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:44 user nova-compute[71711]: INFO nova.compute.manager [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Detaching volume 06ddc1aa-31ff-4da3-b156-9b5e7f11274b
Apr 12 06:34:44 user nova-compute[71711]: INFO nova.virt.block_device [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Attempting to driver detach volume 06ddc1aa-31ff-4da3-b156-9b5e7f11274b from mountpoint /dev/vdb
Apr 12 06:34:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Attempting to detach device vdb from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:34:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:34:44 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:34:44 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:34:44 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:34:44 user nova-compute[71711]:   <serial>06ddc1aa-31ff-4da3-b156-9b5e7f11274b</serial>
Apr 12 06:34:44 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:34:44 user nova-compute[71711]: </disk>
Apr 12 06:34:44 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:34:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Successfully detached device vdb from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the persistent domain config.
Apr 12 06:34:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:34:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:34:44 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:34:44 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:34:44 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:34:44 user nova-compute[71711]:   <serial>06ddc1aa-31ff-4da3-b156-9b5e7f11274b</serial>
Apr 12 06:34:44 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:34:44 user nova-compute[71711]: </disk>
Apr 12 06:34:44 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681281285.3624225, 3770a397-2124-4648-abad-d3ce6483e3b2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:34:45 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Successfully detached device vdb from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the live domain config.
Apr 12 06:34:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFnrsXSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:34:45 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b077553a-f14c-4b58-9a70-0a31e744df86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:34:45 user nova-compute[71711]: No targets found.
Apr 12 06:34:45 user nova-compute[71711]: iSNS:
Apr 12 06:34:45 user nova-compute[71711]: No targets found.
Apr 12 06:34:45 user nova-compute[71711]: STATIC:
Apr 12 06:34:45 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b
Apr 12 06:34:45 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:45 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:45 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7
Apr 12 06:34:45 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:45 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:45 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff
Apr 12 06:34:45 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:45 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:45 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44
Apr 12 06:34:45 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:45 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:45 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:34:45 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:34:45 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:34:45 user nova-compute[71711]: FIRMWARE:
Apr 12 06:34:45 user nova-compute[71711]: No targets found.
Apr 12 06:34:45 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:34:45 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:34:45 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1882b2-cbe4-4ddd-aacd-8ef295737da5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[03028819-264f-445a-b152-94fb566173d3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:45 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:45 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:45 user nova-compute[71711]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)
Apr 12 06:34:45 user nova-compute[71711]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b (non-flash)
Apr 12 06:34:45 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:34:45 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:34:45 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:34:45 user nova-compute[71711]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a97e458-f71b-43df-a273-03e227d9abff (non-flash)
Apr 12 06:34:45 user nova-compute[71711]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b (non-flash)
Apr 12 06:34:45 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9954250820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b'): ({'sdf'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Removing single pathed devices sdf {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dc352c-a7d8-4de5-99e8-5e7a09038618]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[757715cd-e8a5-49cd-b7a4-7a96a46c7326]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Flushing IO for device /dev/sdf {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[690334e2-aac8-49d2-98dc-8d55c8ded700]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d4a801-0470-43be-9e9f-20621d3c126a]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef650d-ca28-4ae0-a263-006e0d04888e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8b9d88-2ea5-49a2-b0c8-036bf53e2724]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b, portal: 172.16.0.220,3260]
Apr 12 06:34:45 user nova-compute[71711]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b, portal: 172.16.0.220,3260] successful.
Apr 12 06:34:45 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ddc1aa-31ff-4da3-b156-9b5e7f11274b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aebef64-2ae6-44cb-bfdb-3d9792405929]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] <== disconnect_volume: return (346ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:34:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:34:46 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'flavor' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:34:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ce93f419-5878-47f1-a1d2-2ca6b7b3fcbc tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.774s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:48 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:34:49 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:34:49 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:34:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:34:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.rescue --force-share --output=json" returned: 0 in 1.867s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:34:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:34:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "faa2ad52-9528-4013-ad20-4a1d636aed14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:55 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:34:55 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7846MB free_disk=25.71459197998047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.manager [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 3770a397-2124-4648-abad-d3ce6483e3b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance faa2ad52-9528-4013-ad20-4a1d636aed14 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.437s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:34:55 user nova-compute[71711]: INFO nova.compute.claims [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Claim successful on node user
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:34:55 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:34:56 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.policy [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:34:56 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Creating image(s)
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "/opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "/opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "/opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.159s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk 1073741824" returned: 0 in 0.051s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Successfully created port: 07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Cannot resize image /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.objects.instance [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'migration_context' on Instance uuid faa2ad52-9528-4013-ad20-4a1d636aed14 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Ensure instance console log exists: /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Updating instance_info_cache with network_info: [{"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG nova.network.neutron [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Successfully updated port: 07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "refresh_cache-faa2ad52-9528-4013-ad20-4a1d636aed14" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquired lock "refresh_cache-faa2ad52-9528-4013-ad20-4a1d636aed14" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG nova.network.neutron [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG nova.compute.manager [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received event network-changed-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG nova.compute.manager [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Refreshing instance network info cache due to event network-changed-07855ce5-9604-4b55-86e2-1c4dfe89d70f. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] Acquiring lock "refresh_cache-faa2ad52-9528-4013-ad20-4a1d636aed14" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG nova.network.neutron [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG nova.network.neutron [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Updating instance_info_cache with network_info: [{"id": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "address": "fa:16:3e:d7:dc:4b", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07855ce5-96", "ovs_interfaceid": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Releasing lock "refresh_cache-faa2ad52-9528-4013-ad20-4a1d636aed14" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG nova.compute.manager [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Instance network_info: |[{"id": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "address": "fa:16:3e:d7:dc:4b", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07855ce5-96", "ovs_interfaceid": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] Acquired lock "refresh_cache-faa2ad52-9528-4013-ad20-4a1d636aed14" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG nova.network.neutron [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Refreshing network info cache for port 07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:34:57 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Start _get_guest_xml network_info=[{"id": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "address": "fa:16:3e:d7:dc:4b", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07855ce5-96", "ovs_interfaceid": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:34:57 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:34:57 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1846086682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1846086682',id=28,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-oy53gvy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:34:56Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=faa2ad52-9528-4013-ad20-4a1d636aed14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "address": "fa:16:3e:d7:dc:4b", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07855ce5-96", "ovs_interfaceid": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "address": "fa:16:3e:d7:dc:4b", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07855ce5-96", "ovs_interfaceid": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=07855ce5-9604-4b55-86e2-1c4dfe89d70f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07855ce5-96') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.objects.instance [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'pci_devices' on Instance uuid faa2ad52-9528-4013-ad20-4a1d636aed14 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:34:58 user nova-compute[71711]:   <uuid>faa2ad52-9528-4013-ad20-4a1d636aed14</uuid>
Apr 12 06:34:58 user nova-compute[71711]:   <name>instance-0000001c</name>
Apr 12 06:34:58 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:34:58 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:34:58 user nova-compute[71711]:   <metadata>
Apr 12 06:34:58 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:34:58 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:34:58 user nova-compute[71711]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1846086682</nova:name>
Apr 12 06:34:58 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:34:58</nova:creationTime>
Apr 12 06:34:58 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:34:58 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:34:58 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:34:58 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:34:58 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:34:58 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:34:58 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:34:58 user nova-compute[71711]:       <nova:owner>
Apr 12 06:34:58 user nova-compute[71711]:         <nova:user uuid="2e5e4455358643b8830ce8c96aad5aad">tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member</nova:user>
Apr 12 06:34:58 user nova-compute[71711]:         <nova:project uuid="0ecae91e53ee4d70a8dc24c7febc2a0e">tempest-ServerBootFromVolumeStableRescueTest-2063268056</nova:project>
Apr 12 06:34:58 user nova-compute[71711]:       </nova:owner>
Apr 12 06:34:58 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:34:58 user nova-compute[71711]:       <nova:ports>
Apr 12 06:34:58 user nova-compute[71711]:         <nova:port uuid="07855ce5-9604-4b55-86e2-1c4dfe89d70f">
Apr 12 06:34:58 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 06:34:58 user nova-compute[71711]:         </nova:port>
Apr 12 06:34:58 user nova-compute[71711]:       </nova:ports>
Apr 12 06:34:58 user nova-compute[71711]:     </nova:instance>
Apr 12 06:34:58 user nova-compute[71711]:   </metadata>
Apr 12 06:34:58 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:34:58 user nova-compute[71711]:     <system>
Apr 12 06:34:58 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:34:58 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:34:58 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:34:58 user nova-compute[71711]:       <entry name="serial">faa2ad52-9528-4013-ad20-4a1d636aed14</entry>
Apr 12 06:34:58 user nova-compute[71711]:       <entry name="uuid">faa2ad52-9528-4013-ad20-4a1d636aed14</entry>
Apr 12 06:34:58 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:34:58 user nova-compute[71711]:     </system>
Apr 12 06:34:58 user nova-compute[71711]:   </sysinfo>
Apr 12 06:34:58 user nova-compute[71711]:   <os>
Apr 12 06:34:58 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:34:58 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:34:58 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:34:58 user nova-compute[71711]:   </os>
Apr 12 06:34:58 user nova-compute[71711]:   <features>
Apr 12 06:34:58 user nova-compute[71711]:     <acpi/>
Apr 12 06:34:58 user nova-compute[71711]:     <apic/>
Apr 12 06:34:58 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:34:58 user nova-compute[71711]:   </features>
Apr 12 06:34:58 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:34:58 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:34:58 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:34:58 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:34:58 user nova-compute[71711]:   </clock>
Apr 12 06:34:58 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:34:58 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:34:58 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:34:58 user nova-compute[71711]:   </cpu>
Apr 12 06:34:58 user nova-compute[71711]:   <devices>
Apr 12 06:34:58 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:34:58 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:34:58 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk"/>
Apr 12 06:34:58 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:34:58 user nova-compute[71711]:     </disk>
Apr 12 06:34:58 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:34:58 user nova-compute[71711]:       <mac address="fa:16:3e:d7:dc:4b"/>
Apr 12 06:34:58 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:34:58 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:34:58 user nova-compute[71711]:       <target dev="tap07855ce5-96"/>
Apr 12 06:34:58 user nova-compute[71711]:     </interface>
Apr 12 06:34:58 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:34:58 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/console.log" append="off"/>
Apr 12 06:34:58 user nova-compute[71711]:     </serial>
Apr 12 06:34:58 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:34:58 user nova-compute[71711]:     <video>
Apr 12 06:34:58 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:34:58 user nova-compute[71711]:     </video>
Apr 12 06:34:58 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:34:58 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:34:58 user nova-compute[71711]:     </rng>
Apr 12 06:34:58 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:34:58 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:34:58 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:34:58 user nova-compute[71711]:     </memballoon>
Apr 12 06:34:58 user nova-compute[71711]:   </devices>
Apr 12 06:34:58 user nova-compute[71711]: </domain>
Apr 12 06:34:58 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1846086682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1846086682',id=28,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-oy53gvy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:34:56Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=faa2ad52-9528-4013-ad20-4a1d636aed14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "address": "fa:16:3e:d7:dc:4b", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07855ce5-96", "ovs_interfaceid": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "address": "fa:16:3e:d7:dc:4b", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07855ce5-96", "ovs_interfaceid": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=07855ce5-9604-4b55-86e2-1c4dfe89d70f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07855ce5-96') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG os_vif [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=07855ce5-9604-4b55-86e2-1c4dfe89d70f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07855ce5-96') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07855ce5-96, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07855ce5-96, col_values=(('external_ids', {'iface-id': '07855ce5-9604-4b55-86e2-1c4dfe89d70f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:dc:4b', 'vm-uuid': 'faa2ad52-9528-4013-ad20-4a1d636aed14'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:58 user nova-compute[71711]: INFO os_vif [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=07855ce5-9604-4b55-86e2-1c4dfe89d70f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07855ce5-96')
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No VIF found with MAC fa:16:3e:d7:dc:4b, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.network.neutron [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Updated VIF entry in instance network info cache for port 07855ce5-9604-4b55-86e2-1c4dfe89d70f. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG nova.network.neutron [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Updating instance_info_cache with network_info: [{"id": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "address": "fa:16:3e:d7:dc:4b", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07855ce5-96", "ovs_interfaceid": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:34:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fa0eae00-7cff-4a17-a34a-252fb987b19e req-012d4ad0-741f-4da0-9328-520645afabd5 service nova] Releasing lock "refresh_cache-faa2ad52-9528-4013-ad20-4a1d636aed14" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:34:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:59 user nova-compute[71711]: DEBUG nova.compute.manager [req-74296a72-04b2-4f75-8d37-e4b0f8dce559 req-b6a7fb9a-ccf6-493d-a968-a3e10055e47b service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received event network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:34:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-74296a72-04b2-4f75-8d37-e4b0f8dce559 req-b6a7fb9a-ccf6-493d-a968-a3e10055e47b service nova] Acquiring lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:34:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-74296a72-04b2-4f75-8d37-e4b0f8dce559 req-b6a7fb9a-ccf6-493d-a968-a3e10055e47b service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:34:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-74296a72-04b2-4f75-8d37-e4b0f8dce559 req-b6a7fb9a-ccf6-493d-a968-a3e10055e47b service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:34:59 user nova-compute[71711]: DEBUG nova.compute.manager [req-74296a72-04b2-4f75-8d37-e4b0f8dce559 req-b6a7fb9a-ccf6-493d-a968-a3e10055e47b service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] No waiting events found dispatching network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:34:59 user nova-compute[71711]: WARNING nova.compute.manager [req-74296a72-04b2-4f75-8d37-e4b0f8dce559 req-b6a7fb9a-ccf6-493d-a968-a3e10055e47b service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received unexpected event network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance with vm_state building and task_state spawning.
Apr 12 06:34:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:34:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:00 user nova-compute[71711]: INFO nova.compute.manager [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Unrescuing
Apr 12 06:35:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:35:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquired lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:35:00 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.network.neutron [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Updating instance_info_cache with network_info: [{"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Releasing lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.objects.instance [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'flavor' on Instance uuid 5364688b-cc08-4407-94f5-974846ae7bb8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281301.7177038, faa2ad52-9528-4013-ad20-4a1d636aed14 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:35:01 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] VM Resumed (Lifecycle Event)
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-37938422-2569-4463-a627-3a87b2549ca5 req-1cc2e6cf-c85e-4e87-b84a-89345d7a4c82 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-unplugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-37938422-2569-4463-a627-3a87b2549ca5 req-1cc2e6cf-c85e-4e87-b84a-89345d7a4c82 service nova] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-37938422-2569-4463-a627-3a87b2549ca5 req-1cc2e6cf-c85e-4e87-b84a-89345d7a4c82 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-37938422-2569-4463-a627-3a87b2549ca5 req-1cc2e6cf-c85e-4e87-b84a-89345d7a4c82 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-37938422-2569-4463-a627-3a87b2549ca5 req-1cc2e6cf-c85e-4e87-b84a-89345d7a4c82 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] No waiting events found dispatching network-vif-unplugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:35:01 user nova-compute[71711]: WARNING nova.compute.manager [req-37938422-2569-4463-a627-3a87b2549ca5 req-1cc2e6cf-c85e-4e87-b84a-89345d7a4c82 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received unexpected event network-vif-unplugged-92e5c952-1e00-4dde-8dcc-dc876149d896 for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:35:01 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Instance spawned successfully.
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-f9b01700-7ffe-473b-95b1-54531c783386 req-cf0a939f-b8e4-475c-97e9-797e7f0f19dc service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received event network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f9b01700-7ffe-473b-95b1-54531c783386 req-cf0a939f-b8e4-475c-97e9-797e7f0f19dc service nova] Acquiring lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f9b01700-7ffe-473b-95b1-54531c783386 req-cf0a939f-b8e4-475c-97e9-797e7f0f19dc service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f9b01700-7ffe-473b-95b1-54531c783386 req-cf0a939f-b8e4-475c-97e9-797e7f0f19dc service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-f9b01700-7ffe-473b-95b1-54531c783386 req-cf0a939f-b8e4-475c-97e9-797e7f0f19dc service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] No waiting events found dispatching network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:35:01 user nova-compute[71711]: WARNING nova.compute.manager [req-f9b01700-7ffe-473b-95b1-54531c783386 req-cf0a939f-b8e4-475c-97e9-797e7f0f19dc service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received unexpected event network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance with vm_state building and task_state spawning.
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:35:01 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281301.7191267, faa2ad52-9528-4013-ad20-4a1d636aed14 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:35:01 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] VM Started (Lifecycle Event)
Apr 12 06:35:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:35:01 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:35:01 user nova-compute[71711]: INFO nova.compute.manager [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Took 5.65 seconds to spawn the instance on the hypervisor.
Apr 12 06:35:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:35:02 user nova-compute[71711]: INFO nova.compute.manager [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Took 6.90 seconds to build instance.
Apr 12 06:35:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72b97de4-355d-4a84-b903-91e8a1712341 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:02 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Instance destroyed successfully.
Apr 12 06:35:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:03 user nova-compute[71711]: DEBUG nova.compute.manager [req-6a66ab07-50a7-4651-8284-572daccf445e req-edfdfe8f-43c2-405e-b1cd-9aedc6975961 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:35:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6a66ab07-50a7-4651-8284-572daccf445e req-edfdfe8f-43c2-405e-b1cd-9aedc6975961 service nova] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6a66ab07-50a7-4651-8284-572daccf445e req-edfdfe8f-43c2-405e-b1cd-9aedc6975961 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6a66ab07-50a7-4651-8284-572daccf445e req-edfdfe8f-43c2-405e-b1cd-9aedc6975961 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:03 user nova-compute[71711]: DEBUG nova.compute.manager [req-6a66ab07-50a7-4651-8284-572daccf445e req-edfdfe8f-43c2-405e-b1cd-9aedc6975961 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] No waiting events found dispatching network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:35:03 user nova-compute[71711]: WARNING nova.compute.manager [req-6a66ab07-50a7-4651-8284-572daccf445e req-edfdfe8f-43c2-405e-b1cd-9aedc6975961 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received unexpected event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:35:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:35:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] No waiting events found dispatching network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:35:05 user nova-compute[71711]: WARNING nova.compute.manager [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received unexpected event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:35:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:35:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] No waiting events found dispatching network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:35:05 user nova-compute[71711]: WARNING nova.compute.manager [req-6e3ec523-8167-485c-90c1-c7b2156c65a8 req-501bbd9c-c5fd-49c1-b652-22cf7f18e6a0 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received unexpected event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:35:05 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for 5364688b-cc08-4407-94f5-974846ae7bb8 due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:35:05 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281305.9394014, 5364688b-cc08-4407-94f5-974846ae7bb8 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:35:05 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] VM Resumed (Lifecycle Event)
Apr 12 06:35:05 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3777beb1-c65d-40de-be56-396ed75828be tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:35:05 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:35:05 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:35:06 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 06:35:06 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281305.9407206, 5364688b-cc08-4407-94f5-974846ae7bb8 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:35:06 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] VM Started (Lifecycle Event)
Apr 12 06:35:06 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:35:06 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:35:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:16 user nova-compute[71711]: DEBUG nova.compute.manager [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Received event network-changed-e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:35:16 user nova-compute[71711]: DEBUG nova.compute.manager [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Refreshing instance network info cache due to event network-changed-e46a4182-23c8-4fd1-9440-cdac8b154ac3. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:35:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] Acquiring lock "refresh_cache-143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:35:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] Acquired lock "refresh_cache-143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:35:16 user nova-compute[71711]: DEBUG nova.network.neutron [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Refreshing network info cache for port e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:35:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:16 user nova-compute[71711]: INFO nova.compute.manager [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Terminating instance
Apr 12 06:35:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:35:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG nova.network.neutron [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Updated VIF entry in instance network info cache for port e46a4182-23c8-4fd1-9440-cdac8b154ac3. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG nova.network.neutron [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Updating instance_info_cache with network_info: [{"id": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "address": "fa:16:3e:86:38:75", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46a4182-23", "ovs_interfaceid": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-ad79428c-2b29-415b-b27e-b93c2c7fa662 req-50041ecc-2f06-43e6-a9ff-dd06cac641a7 service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Received event network-vif-unplugged-e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ad79428c-2b29-415b-b27e-b93c2c7fa662 req-50041ecc-2f06-43e6-a9ff-dd06cac641a7 service nova] Acquiring lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ad79428c-2b29-415b-b27e-b93c2c7fa662 req-50041ecc-2f06-43e6-a9ff-dd06cac641a7 service nova] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ad79428c-2b29-415b-b27e-b93c2c7fa662 req-50041ecc-2f06-43e6-a9ff-dd06cac641a7 service nova] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-ad79428c-2b29-415b-b27e-b93c2c7fa662 req-50041ecc-2f06-43e6-a9ff-dd06cac641a7 service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] No waiting events found dispatching network-vif-unplugged-e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-ad79428c-2b29-415b-b27e-b93c2c7fa662 req-50041ecc-2f06-43e6-a9ff-dd06cac641a7 service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Received event network-vif-unplugged-e46a4182-23c8-4fd1-9440-cdac8b154ac3 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-80e097a0-ad5d-4323-bcc1-ae781eb1a679 req-5fc5f709-dc5c-4800-a917-d49bb80e6a8b service nova] Releasing lock "refresh_cache-143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:17 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Instance destroyed successfully.
Apr 12 06:35:17 user nova-compute[71711]: DEBUG nova.objects.instance [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'resources' on Instance uuid 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-945949060',display_name='tempest-AttachVolumeNegativeTest-server-945949060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-945949060',id=26,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNwlM6zSnkK1jad1V9qKi524+E4rmQa144JesydPzqH82Ovc0LOKIywWpQOwMA7pWSHkpAa5K56dCsv1Gsc/gnYUBqF08xTKKJ5aK4Ulo5NbEwkjx1hIBc1S3H5NYx0MQ==',key_name='tempest-keypair-1092224738',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:33:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b267dce1303d451ca307eeaa38baf685',ramdisk_id='',reservation_id='r-gxpxa80r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1905486920',owner_user_name='tempest-AttachVolumeNegativeTest-1905486920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',uuid=143e1e28-20bd-4cdc-b9e4-c199a3d42e3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "address": "fa:16:3e:86:38:75", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46a4182-23", "ovs_interfaceid": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converting VIF {"id": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "address": "fa:16:3e:86:38:75", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46a4182-23", "ovs_interfaceid": "e46a4182-23c8-4fd1-9440-cdac8b154ac3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:38:75,bridge_name='br-int',has_traffic_filtering=True,id=e46a4182-23c8-4fd1-9440-cdac8b154ac3,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46a4182-23') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG os_vif [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:38:75,bridge_name='br-int',has_traffic_filtering=True,id=e46a4182-23c8-4fd1-9440-cdac8b154ac3,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46a4182-23') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape46a4182-23, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:35:17 user nova-compute[71711]: INFO os_vif [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:38:75,bridge_name='br-int',has_traffic_filtering=True,id=e46a4182-23c8-4fd1-9440-cdac8b154ac3,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46a4182-23')
Apr 12 06:35:17 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Deleting instance files /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c_del
Apr 12 06:35:17 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Deletion of /opt/stack/data/nova/instances/143e1e28-20bd-4cdc-b9e4-c199a3d42e3c_del complete
Apr 12 06:35:17 user nova-compute[71711]: INFO nova.compute.manager [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 06:35:17 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:35:17 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:35:18 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:35:18 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Took 0.86 seconds to deallocate network for instance.
Apr 12 06:35:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-860a64b7-b436-4edc-8430-70bb10f425ac req-f46f3a2a-8878-4277-b3fa-3901290b45df service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Received event network-vif-deleted-e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:35:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:18 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:35:18 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:35:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:18 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Deleted allocations for instance 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c
Apr 12 06:35:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-675d8e27-a78d-421c-9eee-b46b933cff10 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-c6e0ee53-5401-4fa3-9027-6f3b33443b0c req-91d257fd-c24f-41f6-a6ce-c361c640bcfc service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Received event network-vif-plugged-e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:35:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c6e0ee53-5401-4fa3-9027-6f3b33443b0c req-91d257fd-c24f-41f6-a6ce-c361c640bcfc service nova] Acquiring lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c6e0ee53-5401-4fa3-9027-6f3b33443b0c req-91d257fd-c24f-41f6-a6ce-c361c640bcfc service nova] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c6e0ee53-5401-4fa3-9027-6f3b33443b0c req-91d257fd-c24f-41f6-a6ce-c361c640bcfc service nova] Lock "143e1e28-20bd-4cdc-b9e4-c199a3d42e3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-c6e0ee53-5401-4fa3-9027-6f3b33443b0c req-91d257fd-c24f-41f6-a6ce-c361c640bcfc service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] No waiting events found dispatching network-vif-plugged-e46a4182-23c8-4fd1-9440-cdac8b154ac3 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:35:19 user nova-compute[71711]: WARNING nova.compute.manager [req-c6e0ee53-5401-4fa3-9027-6f3b33443b0c req-91d257fd-c24f-41f6-a6ce-c361c640bcfc service nova] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Received unexpected event network-vif-plugged-e46a4182-23c8-4fd1-9440-cdac8b154ac3 for instance with vm_state deleted and task_state None.
Apr 12 06:35:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:23 user nova-compute[71711]: INFO nova.compute.manager [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Terminating instance
Apr 12 06:35:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-a7762386-8046-49e9-90b0-82116ab0c1d3 req-a2151384-a042-41c3-b171-8d814636599b service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a7762386-8046-49e9-90b0-82116ab0c1d3 req-a2151384-a042-41c3-b171-8d814636599b service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a7762386-8046-49e9-90b0-82116ab0c1d3 req-a2151384-a042-41c3-b171-8d814636599b service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a7762386-8046-49e9-90b0-82116ab0c1d3 req-a2151384-a042-41c3-b171-8d814636599b service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-a7762386-8046-49e9-90b0-82116ab0c1d3 req-a2151384-a042-41c3-b171-8d814636599b service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:35:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-a7762386-8046-49e9-90b0-82116ab0c1d3 req-a2151384-a042-41c3-b171-8d814636599b service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-unplugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:24 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Instance destroyed successfully.
Apr 12 06:35:24 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'resources' on Instance uuid 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1807692588',display_name='tempest-ServerActionsTestJSON-server-1279128249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1807692588',id=4,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:32:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-hktvsdi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=5b5758b9-4f7e-4e85-8181-e3dfdd84e624,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "address": "fa:16:3e:7c:bb:4d", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fba3fe8-62", "ovs_interfaceid": "8fba3fe8-62b6-46be-a025-3ec5a629ee80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_vif [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fba3fe8-62, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:35:24 user nova-compute[71711]: INFO os_vif [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=8fba3fe8-62b6-46be-a025-3ec5a629ee80,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fba3fe8-62')
Apr 12 06:35:24 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akKCItqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:35:24 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75f948f-bbec-4a87-96c5-1fe9339fa46f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:35:24 user nova-compute[71711]: No targets found.
Apr 12 06:35:24 user nova-compute[71711]: iSNS:
Apr 12 06:35:24 user nova-compute[71711]: No targets found.
Apr 12 06:35:24 user nova-compute[71711]: STATIC:
Apr 12 06:35:24 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7
Apr 12 06:35:24 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:35:24 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:35:24 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44
Apr 12 06:35:24 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:35:24 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:35:24 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:35:24 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:35:24 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:35:24 user nova-compute[71711]: FIRMWARE:
Apr 12 06:35:24 user nova-compute[71711]: No targets found.
Apr 12 06:35:24 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:35:24 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:35:24 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[186e0906-3c89-49b7-a7e2-f28929594046]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bc31bb-16ae-4a4b-8037-44eda17c772e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:35:24 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:35:24 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:35:24 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:35:24 user nova-compute[71711]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 (non-flash)
Apr 12 06:35:24 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:35:24 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f99542508b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7'): ({'sdd'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Removing single pathed devices sdd {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a97a766-d350-43c6-9a5e-d127d30caa19]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b751836-6730-4815-9aee-67bf134d2ab6]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flushing IO for device /dev/sdd {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eabcc8-2033-4588-97ee-937c81ed3ad7]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d71feb-1a1c-4c04-a3f5-4aaea7c14e7e]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e62101a-3749-4947-afeb-e90a8a785e89]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a63698-82f4-4dc7-b3c7-20eff0329e22]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260]
Apr 12 06:35:24 user nova-compute[71711]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7, portal: 172.16.0.220,3260] successful.
Apr 12 06:35:24 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c60c20a0-2f6f-42a4-a4e5-a6eaf9a653f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[942a9b70-b431-469d-a65e-5317705d17b8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== disconnect_volume: return (359ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:35:24 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Deleting instance files /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624_del
Apr 12 06:35:24 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Deletion of /opt/stack/data/nova/instances/5b5758b9-4f7e-4e85-8181-e3dfdd84e624_del complete
Apr 12 06:35:24 user nova-compute[71711]: INFO nova.compute.manager [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Took 1.37 seconds to destroy the instance on the hypervisor.
Apr 12 06:35:24 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:35:24 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:35:26 user nova-compute[71711]: DEBUG nova.compute.manager [req-b73b59fe-5a15-445e-8733-869e94c3cfd6 req-e8bee173-541b-4be3-95b7-6ca55d4dcdad service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:35:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b73b59fe-5a15-445e-8733-869e94c3cfd6 req-e8bee173-541b-4be3-95b7-6ca55d4dcdad service nova] Acquiring lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b73b59fe-5a15-445e-8733-869e94c3cfd6 req-e8bee173-541b-4be3-95b7-6ca55d4dcdad service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b73b59fe-5a15-445e-8733-869e94c3cfd6 req-e8bee173-541b-4be3-95b7-6ca55d4dcdad service nova] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:26 user nova-compute[71711]: DEBUG nova.compute.manager [req-b73b59fe-5a15-445e-8733-869e94c3cfd6 req-e8bee173-541b-4be3-95b7-6ca55d4dcdad service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] No waiting events found dispatching network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:35:26 user nova-compute[71711]: WARNING nova.compute.manager [req-b73b59fe-5a15-445e-8733-869e94c3cfd6 req-e8bee173-541b-4be3-95b7-6ca55d4dcdad service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received unexpected event network-vif-plugged-8fba3fe8-62b6-46be-a025-3ec5a629ee80 for instance with vm_state active and task_state deleting.
Apr 12 06:35:26 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:35:26 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Took 1.10 seconds to deallocate network for instance.
Apr 12 06:35:26 user nova-compute[71711]: DEBUG nova.compute.manager [req-dcdb8f31-3cc4-4199-a301-34bbe9efb2ec req-f12702eb-d349-49ef-b3fb-605084ca2cfa service nova] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Received event network-vif-deleted-8fba3fe8-62b6-46be-a025-3ec5a629ee80 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:35:26 user nova-compute[71711]: INFO nova.compute.manager [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Took 0.78 seconds to detach 1 volumes for instance.
Apr 12 06:35:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:27 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:35:27 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:35:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:27 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Deleted allocations for instance 5b5758b9-4f7e-4e85-8181-e3dfdd84e624
Apr 12 06:35:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e373a48e-2621-4167-9c86-9e005c6c9cdb tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "5b5758b9-4f7e-4e85-8181-e3dfdd84e624" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.723s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:32 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281317.5397184, 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:35:32 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] VM Stopped (Lifecycle Event)
Apr 12 06:35:32 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e8c8c406-1b56-4a72-b0d5-5506bf674a91 None None] [instance: 143e1e28-20bd-4cdc-b9e4-c199a3d42e3c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:35:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG nova.objects.instance [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'flavor' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-changed-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Refreshing instance network info cache due to event network-changed-f90233ae-9ecb-48be-baf0-7e517849679d. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] Acquiring lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] Acquired lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG nova.network.neutron [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Refreshing network info cache for port f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:38 user nova-compute[71711]: INFO nova.compute.manager [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Attaching volume 8048631f-b3d7-4509-84f6-a042d0643041 to /dev/vdb
Apr 12 06:35:38 user nova-compute[71711]: DEBUG os_brick.utils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55b807f-f31f-4009-98b3-4b28bd390340]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[045f8f21-4699-47ff-abab-67f3cb6083c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4403344e-89d9-4245-a6a0-55049362b9a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb46c7c-1067-4b94-86f1-4385ad78b39a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:35:38 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0dea7a-b50c-4986-b38d-76fa7fcf47cd]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG os_brick.utils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Updating existing volume attachment record: 1725c085-2448-4629-838a-ceb959d5bace {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG nova.network.neutron [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Updated VIF entry in instance network info cache for port f90233ae-9ecb-48be-baf0-7e517849679d. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG nova.network.neutron [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Updating instance_info_cache with network_info: [{"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:35:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-57b9e5df-a17d-4173-bb6b-09565fd9ebfd req-4f03018a-976e-492b-b4a4-534a892b7f1c service nova] Releasing lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:35:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:39 user nova-compute[71711]: DEBUG nova.compute.manager [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:35:39 user nova-compute[71711]: INFO nova.compute.manager [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] instance snapshotting
Apr 12 06:35:39 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Beginning live snapshot process
Apr 12 06:35:39 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281324.3943021, 5b5758b9-4f7e-4e85-8181-e3dfdd84e624 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:35:39 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] VM Stopped (Lifecycle Event)
Apr 12 06:35:39 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ca7d5e3e-c7bc-4827-9cfd-28ab64ebcbb2 None None] [instance: 5b5758b9-4f7e-4e85-8181-e3dfdd84e624] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:35:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json -f qcow2 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json -f qcow2" returned: 0 in 0.162s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json -f qcow2 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxi1pyu6o/33843d74568f4ba8b7afb046dacd78f6.delta 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxi1pyu6o/33843d74568f4ba8b7afb046dacd78f6.delta 1073741824" returned: 0 in 0.194s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:40 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 06:35:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:35:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:35:41 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 06:35:41 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:35:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxi1pyu6o/33843d74568f4ba8b7afb046dacd78f6.delta /opt/stack/data/nova/instances/snapshots/tmpxi1pyu6o/33843d74568f4ba8b7afb046dacd78f6 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxi1pyu6o/33843d74568f4ba8b7afb046dacd78f6.delta /opt/stack/data/nova/instances/snapshots/tmpxi1pyu6o/33843d74568f4ba8b7afb046dacd78f6" returned: 0 in 0.324s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:41 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Snapshot extracted, beginning image upload
Apr 12 06:35:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:35:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEulydVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:35:42 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:35:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:35:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:35:42 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:35:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:35:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:35:42 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:35:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35c6733-4ca3-4204-a7c3-3418484b4db1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:35:42 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd796e2-c440-4ba4-bc8a-0e9a587d7883]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041] added
Apr 12 06:35:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[60687a61-7608-4f20-b34c-86544f86c7af]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f91d75-d46b-4587-be9e-d1abf9f2e718]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEulydVm {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEulydVm" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cc3cc7-2a0a-4310-8a54-45b9c7fb63b3]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CEulydVm'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff70787-e300-4b28-83f7-a557f07dc5b5]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e05797a-ed52-4938-89a8-12aeef6908af]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:35:43 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:35:43 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:35:43 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:35:43 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd82d1e-7f0f-41a8-ba4f-f2964f5afad5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041, portal: 172.16.0.220,3260]
Apr 12 06:35:43 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041, portal: 172.16.0.220,3260] successful.
Apr 12 06:35:43 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a347ce34-5b73-4e80-80f0-1ae6a87a5b5a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b65ee5-de4d-4143-b7cd-9bed8689e34a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:35:43 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:35:43 user nova-compute[71711]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 (non-flash)
Apr 12 06:35:43 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:35:43 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:35:43 user nova-compute[71711]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 (non-flash)
Apr 12 06:35:43 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a20625c-ddc4-4d6b-9eb7-961b974bf08e]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:35:43 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEulydVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:35:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Snapshot image upload complete
Apr 12 06:35:44 user nova-compute[71711]: INFO nova.compute.manager [None req-22c4be65-6977-4e55-bbfe-ec1d0199ea02 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Took 4.82 seconds to snapshot the instance on the hypervisor.
Apr 12 06:35:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:35:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26562383865336539', 'path': '/dev/sdd'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:35:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562383865336539', 'path': '/dev/sdd'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:35:44 user nova-compute[71711]: DEBUG nova.objects.instance [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'flavor' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:35:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:35:44 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:35:44 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:35:44 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:35:44 user nova-compute[71711]:   <serial>8048631f-b3d7-4509-84f6-a042d0643041</serial>
Apr 12 06:35:44 user nova-compute[71711]: </disk>
Apr 12 06:35:44 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:35:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:35:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:35:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] No VIF found with MAC fa:16:3e:5b:66:97, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:35:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c3bbf8e2-ca7e-4543-a7be-eaa8abf39e34 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.530s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:46 user nova-compute[71711]: INFO nova.compute.manager [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Detaching volume 8048631f-b3d7-4509-84f6-a042d0643041
Apr 12 06:35:46 user nova-compute[71711]: INFO nova.virt.block_device [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Attempting to driver detach volume 8048631f-b3d7-4509-84f6-a042d0643041 from mountpoint /dev/vdb
Apr 12 06:35:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Attempting to detach device vdb from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:35:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:35:46 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:35:46 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:35:46 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:35:46 user nova-compute[71711]:   <serial>8048631f-b3d7-4509-84f6-a042d0643041</serial>
Apr 12 06:35:46 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:35:46 user nova-compute[71711]: </disk>
Apr 12 06:35:46 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:35:46 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Successfully detached device vdb from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the persistent domain config.
Apr 12 06:35:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:35:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:35:46 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:35:46 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:35:46 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:35:46 user nova-compute[71711]:   <serial>8048631f-b3d7-4509-84f6-a042d0643041</serial>
Apr 12 06:35:46 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:35:46 user nova-compute[71711]: </disk>
Apr 12 06:35:46 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681281347.0245602, 3770a397-2124-4648-abad-d3ce6483e3b2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:35:47 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Successfully detached device vdb from instance 3770a397-2124-4648-abad-d3ce6483e3b2 from the live domain config.
Apr 12 06:35:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEulydVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:35:47 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691c089-0323-4b3b-adf1-a6bc9b520cad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:35:47 user nova-compute[71711]: No targets found.
Apr 12 06:35:47 user nova-compute[71711]: iSNS:
Apr 12 06:35:47 user nova-compute[71711]: No targets found.
Apr 12 06:35:47 user nova-compute[71711]: STATIC:
Apr 12 06:35:47 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041
Apr 12 06:35:47 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:35:47 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:35:47 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44
Apr 12 06:35:47 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:35:47 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:35:47 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:35:47 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:35:47 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:35:47 user nova-compute[71711]: FIRMWARE:
Apr 12 06:35:47 user nova-compute[71711]: No targets found.
Apr 12 06:35:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:35:47 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:35:47 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[538ef081-4199-42dd-b7e4-4b73795528af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[495e4a4e-1df7-4703-ba32-bdca6ec6c74e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:35:47 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:35:47 user nova-compute[71711]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 (non-flash)
Apr 12 06:35:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:35:47 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:35:47 user nova-compute[71711]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 (non-flash)
Apr 12 06:35:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c3685e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041'): ({'sdd'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Removing single pathed devices sdd {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56d63db-0ceb-4a7f-a097-0e4d5e48930b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f94309f-3f5e-4d1d-a54e-0553713b3cab]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Flushing IO for device /dev/sdd {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[287af2ec-4d76-4da8-a8d8-100dcf59f1dd]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[270425f0-43be-45db-acf4-8fa9a0076491]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8c6b5f-70ff-4e36-8717-103b04b050d6]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc19b42-3aee-4e64-b218-7347f969bb21]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041, portal: 172.16.0.220,3260]
Apr 12 06:35:47 user nova-compute[71711]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041, portal: 172.16.0.220,3260] successful.
Apr 12 06:35:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8048631f-b3d7-4509-84f6-a042d0643041 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6099d83-e5ef-476b-8b8e-f071a451a88c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] <== disconnect_volume: return (319ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:35:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:35:48 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:35:48 user nova-compute[71711]: DEBUG nova.objects.instance [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'flavor' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:35:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8297db5b-0efc-4e4a-bdda-074bc33bec24 tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.482s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:35:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:35:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:35:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:35:52 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:35:52 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7986MB free_disk=26.165721893310547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 3770a397-2124-4648-abad-d3ce6483e3b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance faa2ad52-9528-4013-ad20-4a1d636aed14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:35:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Updating instance_info_cache with network_info: [{"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:35:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:35:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:54 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:35:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:35:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:08 user nova-compute[71711]: INFO nova.compute.manager [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Detaching volume 7604ff57-70fb-4c5c-abde-c58dab75bf44
Apr 12 06:36:08 user nova-compute[71711]: INFO nova.virt.block_device [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Attempting to driver detach volume 7604ff57-70fb-4c5c-abde-c58dab75bf44 from mountpoint /dev/vdb
Apr 12 06:36:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Attempting to detach device vdb from instance cb572c1a-2901-4b09-920d-e3e0da7765b2 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:36:08 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:36:08 user nova-compute[71711]:   <source dev="/dev/sdc"/>
Apr 12 06:36:08 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:36:08 user nova-compute[71711]:   <serial>7604ff57-70fb-4c5c-abde-c58dab75bf44</serial>
Apr 12 06:36:08 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:36:08 user nova-compute[71711]: </disk>
Apr 12 06:36:08 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:36:08 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully detached device vdb from instance cb572c1a-2901-4b09-920d-e3e0da7765b2 from the persistent domain config.
Apr 12 06:36:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb572c1a-2901-4b09-920d-e3e0da7765b2 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:36:08 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:36:08 user nova-compute[71711]:   <source dev="/dev/sdc"/>
Apr 12 06:36:08 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:36:08 user nova-compute[71711]:   <serial>7604ff57-70fb-4c5c-abde-c58dab75bf44</serial>
Apr 12 06:36:08 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:36:08 user nova-compute[71711]: </disk>
Apr 12 06:36:08 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681281368.874281, cb572c1a-2901-4b09-920d-e3e0da7765b2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb572c1a-2901-4b09-920d-e3e0da7765b2 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:36:08 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully detached device vdb from instance cb572c1a-2901-4b09-920d-e3e0da7765b2 from the live domain config.
Apr 12 06:36:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwscbTLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:36:08 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:36:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cb733f-5a3c-4812-8519-07de2ebb606b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:36:08 user nova-compute[71711]: No targets found.
Apr 12 06:36:08 user nova-compute[71711]: iSNS:
Apr 12 06:36:08 user nova-compute[71711]: No targets found.
Apr 12 06:36:08 user nova-compute[71711]: STATIC:
Apr 12 06:36:08 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44
Apr 12 06:36:08 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:36:08 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:36:08 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:36:08 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:36:08 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:36:08 user nova-compute[71711]: FIRMWARE:
Apr 12 06:36:08 user nova-compute[71711]: No targets found.
Apr 12 06:36:08 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:36:08 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:36:08 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bc4c23-e760-4f35-983a-fb62163e2283]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32603ab-d630-495a-a05c-17ec0c940053]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:36:08 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:36:08 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:36:08 user nova-compute[71711]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 (non-flash)
Apr 12 06:36:08 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c143be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44'): ({'sdc'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Removing single pathed devices sdc {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b58a6c7-e971-4493-b200-2028a82b70dd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:36:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b323f25b-67b7-424e-8f8c-5390602c408b]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flushing IO for device /dev/sdc {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d06efc0-cbf7-4749-a5b7-04d5d048cb30]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c522d923-6527-4b3f-9168-3644f3bc7f69]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba438904-37a8-4e9c-8038-c73943df723f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd1e6d5-ee5f-40de-8247-13b3fef3f6ef]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44, portal: 172.16.0.220,3260]
Apr 12 06:36:09 user nova-compute[71711]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44, portal: 172.16.0.220,3260] successful.
Apr 12 06:36:09 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7604ff57-70fb-4c5c-abde-c58dab75bf44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3ffcb1-0015-4fc9-880c-f2fcf05ff8b9]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] <== disconnect_volume: return (292ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'flavor' on Instance uuid cb572c1a-2901-4b09-920d-e3e0da7765b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:36:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1cb8f1b6-e122-4da7-a741-beffa8f36f76 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.698s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "659489bb-3672-4f70-9ab5-b37f310a7d86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:36:15 user nova-compute[71711]: INFO nova.compute.claims [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Claim successful on node user
Apr 12 06:36:15 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:36:15 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:36:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG nova.policy [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:36:15 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Creating image(s)
Apr 12 06:36:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "/opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "/opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "/opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk 1073741824" returned: 0 in 0.051s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.129s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Cannot resize image /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG nova.objects.instance [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'migration_context' on Instance uuid 659489bb-3672-4f70-9ab5-b37f310a7d86 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Ensure instance console log exists: /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:16 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Successfully created port: 744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Successfully updated port: 744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquired lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Received event network-changed-744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Refreshing instance network info cache due to event network-changed-744814ae-b032-41e5-b122-8d5ff605d349. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] Acquiring lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Updating instance_info_cache with network_info: [{"id": "744814ae-b032-41e5-b122-8d5ff605d349", "address": "fa:16:3e:c2:8c:71", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744814ae-b0", "ovs_interfaceid": "744814ae-b032-41e5-b122-8d5ff605d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Releasing lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Instance network_info: |[{"id": "744814ae-b032-41e5-b122-8d5ff605d349", "address": "fa:16:3e:c2:8c:71", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744814ae-b0", "ovs_interfaceid": "744814ae-b032-41e5-b122-8d5ff605d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] Acquired lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.network.neutron [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Refreshing network info cache for port 744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Start _get_guest_xml network_info=[{"id": "744814ae-b032-41e5-b122-8d5ff605d349", "address": "fa:16:3e:c2:8c:71", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744814ae-b0", "ovs_interfaceid": "744814ae-b032-41e5-b122-8d5ff605d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:36:17 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:36:17 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:36:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-691857628',display_name='tempest-ServerActionsTestJSON-server-691857628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-691857628',id=29,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-7sp5riz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=659489bb-3672-4f70-9ab5-b37f310a7d86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "744814ae-b032-41e5-b122-8d5ff605d349", "address": "fa:16:3e:c2:8c:71", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744814ae-b0", "ovs_interfaceid": "744814ae-b032-41e5-b122-8d5ff605d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "744814ae-b032-41e5-b122-8d5ff605d349", "address": "fa:16:3e:c2:8c:71", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744814ae-b0", "ovs_interfaceid": "744814ae-b032-41e5-b122-8d5ff605d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8c:71,bridge_name='br-int',has_traffic_filtering=True,id=744814ae-b032-41e5-b122-8d5ff605d349,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744814ae-b0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.objects.instance [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'pci_devices' on Instance uuid 659489bb-3672-4f70-9ab5-b37f310a7d86 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:36:17 user nova-compute[71711]:   <uuid>659489bb-3672-4f70-9ab5-b37f310a7d86</uuid>
Apr 12 06:36:17 user nova-compute[71711]:   <name>instance-0000001d</name>
Apr 12 06:36:17 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:36:17 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:36:17 user nova-compute[71711]:   <metadata>
Apr 12 06:36:17 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:36:17 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:36:17 user nova-compute[71711]:       <nova:name>tempest-ServerActionsTestJSON-server-691857628</nova:name>
Apr 12 06:36:17 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:36:17</nova:creationTime>
Apr 12 06:36:17 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:36:17 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:36:17 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:36:17 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:36:17 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:36:17 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:36:17 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:36:17 user nova-compute[71711]:       <nova:owner>
Apr 12 06:36:17 user nova-compute[71711]:         <nova:user uuid="ad316acdc89947bbba60c75e9a24d7e9">tempest-ServerActionsTestJSON-752347644-project-member</nova:user>
Apr 12 06:36:17 user nova-compute[71711]:         <nova:project uuid="54fd87c4105246c1ac1bdf424c83b7aa">tempest-ServerActionsTestJSON-752347644</nova:project>
Apr 12 06:36:17 user nova-compute[71711]:       </nova:owner>
Apr 12 06:36:17 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:36:17 user nova-compute[71711]:       <nova:ports>
Apr 12 06:36:17 user nova-compute[71711]:         <nova:port uuid="744814ae-b032-41e5-b122-8d5ff605d349">
Apr 12 06:36:17 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 06:36:17 user nova-compute[71711]:         </nova:port>
Apr 12 06:36:17 user nova-compute[71711]:       </nova:ports>
Apr 12 06:36:17 user nova-compute[71711]:     </nova:instance>
Apr 12 06:36:17 user nova-compute[71711]:   </metadata>
Apr 12 06:36:17 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:36:17 user nova-compute[71711]:     <system>
Apr 12 06:36:17 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:36:17 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:36:17 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:36:17 user nova-compute[71711]:       <entry name="serial">659489bb-3672-4f70-9ab5-b37f310a7d86</entry>
Apr 12 06:36:17 user nova-compute[71711]:       <entry name="uuid">659489bb-3672-4f70-9ab5-b37f310a7d86</entry>
Apr 12 06:36:17 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:36:17 user nova-compute[71711]:     </system>
Apr 12 06:36:17 user nova-compute[71711]:   </sysinfo>
Apr 12 06:36:17 user nova-compute[71711]:   <os>
Apr 12 06:36:17 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:36:17 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:36:17 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:36:17 user nova-compute[71711]:   </os>
Apr 12 06:36:17 user nova-compute[71711]:   <features>
Apr 12 06:36:17 user nova-compute[71711]:     <acpi/>
Apr 12 06:36:17 user nova-compute[71711]:     <apic/>
Apr 12 06:36:17 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:36:17 user nova-compute[71711]:   </features>
Apr 12 06:36:17 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:36:17 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:36:17 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:36:17 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:36:17 user nova-compute[71711]:   </clock>
Apr 12 06:36:17 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:36:17 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:36:17 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:36:17 user nova-compute[71711]:   </cpu>
Apr 12 06:36:17 user nova-compute[71711]:   <devices>
Apr 12 06:36:17 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:36:17 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:36:17 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk"/>
Apr 12 06:36:17 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:36:17 user nova-compute[71711]:     </disk>
Apr 12 06:36:17 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:36:17 user nova-compute[71711]:       <mac address="fa:16:3e:c2:8c:71"/>
Apr 12 06:36:17 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:36:17 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:36:17 user nova-compute[71711]:       <target dev="tap744814ae-b0"/>
Apr 12 06:36:17 user nova-compute[71711]:     </interface>
Apr 12 06:36:17 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:36:17 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/console.log" append="off"/>
Apr 12 06:36:17 user nova-compute[71711]:     </serial>
Apr 12 06:36:17 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:36:17 user nova-compute[71711]:     <video>
Apr 12 06:36:17 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:36:17 user nova-compute[71711]:     </video>
Apr 12 06:36:17 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:36:17 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:36:17 user nova-compute[71711]:     </rng>
Apr 12 06:36:17 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:36:17 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:36:17 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:36:17 user nova-compute[71711]:     </memballoon>
Apr 12 06:36:17 user nova-compute[71711]:   </devices>
Apr 12 06:36:17 user nova-compute[71711]: </domain>
Apr 12 06:36:17 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:36:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-691857628',display_name='tempest-ServerActionsTestJSON-server-691857628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-691857628',id=29,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-7sp5riz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=659489bb-3672-4f70-9ab5-b37f310a7d86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "744814ae-b032-41e5-b122-8d5ff605d349", "address": "fa:16:3e:c2:8c:71", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744814ae-b0", "ovs_interfaceid": "744814ae-b032-41e5-b122-8d5ff605d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "744814ae-b032-41e5-b122-8d5ff605d349", "address": "fa:16:3e:c2:8c:71", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744814ae-b0", "ovs_interfaceid": "744814ae-b032-41e5-b122-8d5ff605d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8c:71,bridge_name='br-int',has_traffic_filtering=True,id=744814ae-b032-41e5-b122-8d5ff605d349,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744814ae-b0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG os_vif [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8c:71,bridge_name='br-int',has_traffic_filtering=True,id=744814ae-b032-41e5-b122-8d5ff605d349,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744814ae-b0') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap744814ae-b0, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap744814ae-b0, col_values=(('external_ids', {'iface-id': '744814ae-b032-41e5-b122-8d5ff605d349', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:8c:71', 'vm-uuid': '659489bb-3672-4f70-9ab5-b37f310a7d86'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:17 user nova-compute[71711]: INFO os_vif [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:8c:71,bridge_name='br-int',has_traffic_filtering=True,id=744814ae-b032-41e5-b122-8d5ff605d349,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744814ae-b0')
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:36:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No VIF found with MAC fa:16:3e:c2:8c:71, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:36:18 user nova-compute[71711]: DEBUG nova.network.neutron [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Updated VIF entry in instance network info cache for port 744814ae-b032-41e5-b122-8d5ff605d349. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:36:18 user nova-compute[71711]: DEBUG nova.network.neutron [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Updating instance_info_cache with network_info: [{"id": "744814ae-b032-41e5-b122-8d5ff605d349", "address": "fa:16:3e:c2:8c:71", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744814ae-b0", "ovs_interfaceid": "744814ae-b032-41e5-b122-8d5ff605d349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:36:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9373e29f-260f-420d-ba78-4100710255e1 req-cb2aeb94-2af5-45d9-b051-f78ed1476824 service nova] Releasing lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:36:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-39828220-c603-402b-87f3-479c5f212f06 req-341bc883-f4a4-4233-8fd3-ab5372744502 service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Received event network-vif-plugged-744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:36:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-39828220-c603-402b-87f3-479c5f212f06 req-341bc883-f4a4-4233-8fd3-ab5372744502 service nova] Acquiring lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-39828220-c603-402b-87f3-479c5f212f06 req-341bc883-f4a4-4233-8fd3-ab5372744502 service nova] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-39828220-c603-402b-87f3-479c5f212f06 req-341bc883-f4a4-4233-8fd3-ab5372744502 service nova] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-39828220-c603-402b-87f3-479c5f212f06 req-341bc883-f4a4-4233-8fd3-ab5372744502 service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] No waiting events found dispatching network-vif-plugged-744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:36:19 user nova-compute[71711]: WARNING nova.compute.manager [req-39828220-c603-402b-87f3-479c5f212f06 req-341bc883-f4a4-4233-8fd3-ab5372744502 service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Received unexpected event network-vif-plugged-744814ae-b032-41e5-b122-8d5ff605d349 for instance with vm_state building and task_state spawning.
Apr 12 06:36:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281381.3385434, 659489bb-3672-4f70-9ab5-b37f310a7d86 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:36:21 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] VM Resumed (Lifecycle Event)
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:36:21 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Instance spawned successfully.
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:36:21 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281381.339878, 659489bb-3672-4f70-9ab5-b37f310a7d86 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:36:21 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] VM Started (Lifecycle Event)
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:36:21 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:36:21 user nova-compute[71711]: INFO nova.compute.manager [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Took 5.53 seconds to spawn the instance on the hypervisor.
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-7d2d6d0f-2a1b-4b68-9c17-1725ac95f845 req-c2324361-8635-4d95-b27e-dfb494004bd7 service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Received event network-vif-plugged-744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7d2d6d0f-2a1b-4b68-9c17-1725ac95f845 req-c2324361-8635-4d95-b27e-dfb494004bd7 service nova] Acquiring lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7d2d6d0f-2a1b-4b68-9c17-1725ac95f845 req-c2324361-8635-4d95-b27e-dfb494004bd7 service nova] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7d2d6d0f-2a1b-4b68-9c17-1725ac95f845 req-c2324361-8635-4d95-b27e-dfb494004bd7 service nova] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-7d2d6d0f-2a1b-4b68-9c17-1725ac95f845 req-c2324361-8635-4d95-b27e-dfb494004bd7 service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] No waiting events found dispatching network-vif-plugged-744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:36:21 user nova-compute[71711]: WARNING nova.compute.manager [req-7d2d6d0f-2a1b-4b68-9c17-1725ac95f845 req-c2324361-8635-4d95-b27e-dfb494004bd7 service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Received unexpected event network-vif-plugged-744814ae-b032-41e5-b122-8d5ff605d349 for instance with vm_state building and task_state spawning.
Apr 12 06:36:21 user nova-compute[71711]: INFO nova.compute.manager [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Took 6.21 seconds to build instance.
Apr 12 06:36:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e6b8fa1-f083-4c3b-a306-3e9de4fd8070 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.312s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:36:45 user nova-compute[71711]: INFO nova.compute.manager [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] instance snapshotting
Apr 12 06:36:45 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Beginning live snapshot process
Apr 12 06:36:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json -f qcow2 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json -f qcow2" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json -f qcow2 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk04fff3j/c95cb0de65984efba978c3715212e841.delta 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk04fff3j/c95cb0de65984efba978c3715212e841.delta 1073741824" returned: 0 in 0.053s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:46 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 06:36:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] COPY block job progress, current cursor: 327680 final cursor: 43778048 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:36:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71711) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 06:36:47 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 06:36:47 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:36:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk04fff3j/c95cb0de65984efba978c3715212e841.delta /opt/stack/data/nova/instances/snapshots/tmpk04fff3j/c95cb0de65984efba978c3715212e841 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk04fff3j/c95cb0de65984efba978c3715212e841.delta /opt/stack/data/nova/instances/snapshots/tmpk04fff3j/c95cb0de65984efba978c3715212e841" returned: 0 in 0.197s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:47 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Snapshot extracted, beginning image upload
Apr 12 06:36:48 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:36:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:50 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Snapshot image upload complete
Apr 12 06:36:50 user nova-compute[71711]: INFO nova.compute.manager [None req-85bf0c78-7460-487c-bccd-d89061263e8b tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Took 4.65 seconds to snapshot the instance on the hypervisor.
Apr 12 06:36:50 user nova-compute[71711]: DEBUG nova.compute.manager [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Received event network-changed-8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:36:50 user nova-compute[71711]: DEBUG nova.compute.manager [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Refreshing instance network info cache due to event network-changed-8bb8777b-5b83-47be-ab13-4ad7fd67d66c. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:36:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] Acquiring lock "refresh_cache-3770a397-2124-4648-abad-d3ce6483e3b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:36:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] Acquired lock "refresh_cache-3770a397-2124-4648-abad-d3ce6483e3b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:36:50 user nova-compute[71711]: DEBUG nova.network.neutron [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Refreshing network info cache for port 8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG nova.network.neutron [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Updated VIF entry in instance network info cache for port 8bb8777b-5b83-47be-ab13-4ad7fd67d66c. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG nova.network.neutron [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Updating instance_info_cache with network_info: [{"id": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "address": "fa:16:3e:5b:66:97", "network": {"id": "4d619acb-e553-4fd8-ab04-623325eaf182", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-502354801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebdd9f4006d413686bba37f22374759", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8777b-5b", "ovs_interfaceid": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-27aa5ce0-b437-4ad5-b1fe-56bca8c22876 req-e7b26a98-552a-47ed-a318-bafa09ed92a4 service nova] Releasing lock "refresh_cache-3770a397-2124-4648-abad-d3ce6483e3b2" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:36:54 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:36:54 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8015MB free_disk=26.107196807861328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:54 user nova-compute[71711]: INFO nova.compute.manager [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Terminating instance
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 3770a397-2124-4648-abad-d3ce6483e3b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance cb572c1a-2901-4b09-920d-e3e0da7765b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance faa2ad52-9528-4013-ad20-4a1d636aed14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-53b734be-aea7-48f8-9772-8c25ae32c30e req-0bfaaa7d-2224-4329-93b8-9c6ebe969c6f service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Received event network-vif-unplugged-8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-53b734be-aea7-48f8-9772-8c25ae32c30e req-0bfaaa7d-2224-4329-93b8-9c6ebe969c6f service nova] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-53b734be-aea7-48f8-9772-8c25ae32c30e req-0bfaaa7d-2224-4329-93b8-9c6ebe969c6f service nova] Lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-53b734be-aea7-48f8-9772-8c25ae32c30e req-0bfaaa7d-2224-4329-93b8-9c6ebe969c6f service nova] Lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-53b734be-aea7-48f8-9772-8c25ae32c30e req-0bfaaa7d-2224-4329-93b8-9c6ebe969c6f service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] No waiting events found dispatching network-vif-unplugged-8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:36:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-53b734be-aea7-48f8-9772-8c25ae32c30e req-0bfaaa7d-2224-4329-93b8-9c6ebe969c6f service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Received event network-vif-unplugged-8bb8777b-5b83-47be-ab13-4ad7fd67d66c for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:55 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Instance destroyed successfully.
Apr 12 06:36:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lazy-loading 'resources' on Instance uuid 3770a397-2124-4648-abad-d3ce6483e3b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:30:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1794952988',display_name='tempest-SnapshotDataIntegrityTests-server-1794952988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1794952988',id=22,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcgEQFNhIVnT0wxBESUjSnWt8fLNeSczeXi75jsZIJIsHDY3ZCw0iL7p7oChBDAewN3LU2kaBsEIsgV6dzIxe4HbSqe0jpOsMXcUoleoH69sicZfwxhtmAiR7pt/liSYQ==',key_name='tempest-SnapshotDataIntegrityTests-2112427330',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:30:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ebdd9f4006d413686bba37f22374759',ramdisk_id='',reservation_id='r-8o3jne48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2082659614',owner_user_name='tempest-SnapshotDataIntegrityTests-2082659614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:30:44Z,user_data=None,user_id='549eaf8464b64c96ab3c6dde394cc31e',uuid=3770a397-2124-4648-abad-d3ce6483e3b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "address": "fa:16:3e:5b:66:97", "network": {"id": "4d619acb-e553-4fd8-ab04-623325eaf182", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-502354801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebdd9f4006d413686bba37f22374759", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8777b-5b", "ovs_interfaceid": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Converting VIF {"id": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "address": "fa:16:3e:5b:66:97", "network": {"id": "4d619acb-e553-4fd8-ab04-623325eaf182", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-502354801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebdd9f4006d413686bba37f22374759", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bb8777b-5b", "ovs_interfaceid": "8bb8777b-5b83-47be-ab13-4ad7fd67d66c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:66:97,bridge_name='br-int',has_traffic_filtering=True,id=8bb8777b-5b83-47be-ab13-4ad7fd67d66c,network=Network(4d619acb-e553-4fd8-ab04-623325eaf182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8777b-5b') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG os_vif [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:66:97,bridge_name='br-int',has_traffic_filtering=True,id=8bb8777b-5b83-47be-ab13-4ad7fd67d66c,network=Network(4d619acb-e553-4fd8-ab04-623325eaf182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8777b-5b') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bb8777b-5b, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:36:55 user nova-compute[71711]: INFO os_vif [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:66:97,bridge_name='br-int',has_traffic_filtering=True,id=8bb8777b-5b83-47be-ab13-4ad7fd67d66c,network=Network(4d619acb-e553-4fd8-ab04-623325eaf182),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bb8777b-5b')
Apr 12 06:36:55 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Deleting instance files /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2_del
Apr 12 06:36:55 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Deletion of /opt/stack/data/nova/instances/3770a397-2124-4648-abad-d3ce6483e3b2_del complete
Apr 12 06:36:55 user nova-compute[71711]: INFO nova.compute.manager [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 06:36:55 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:36:56 user nova-compute[71711]: INFO nova.compute.claims [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Claim successful on node user
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:36:56 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Took 0.70 seconds to deallocate network for instance.
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Skipping network cache update for instance because it is being deleted. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9841}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-5146c389-c886-4037-8c24-c677093ce3eb req-80bd060f-2360-45cf-b6ed-492f2193e4f9 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Received event network-vif-deleted-8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.361s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:36:56 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.policy [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc8e6af1db834409a4880040a5ef6a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972842dc32ee4687866dfe2fbefe9cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:36:56 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Creating image(s)
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "/opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "/opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-c7af76e1-10e1-4738-b272-bc9d0cc549d2 req-23aa495a-efab-4d13-8b24-541930c81aa5 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Received event network-vif-plugged-8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7af76e1-10e1-4738-b272-bc9d0cc549d2 req-23aa495a-efab-4d13-8b24-541930c81aa5 service nova] Acquiring lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7af76e1-10e1-4738-b272-bc9d0cc549d2 req-23aa495a-efab-4d13-8b24-541930c81aa5 service nova] Lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7af76e1-10e1-4738-b272-bc9d0cc549d2 req-23aa495a-efab-4d13-8b24-541930c81aa5 service nova] Lock "3770a397-2124-4648-abad-d3ce6483e3b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-c7af76e1-10e1-4738-b272-bc9d0cc549d2 req-23aa495a-efab-4d13-8b24-541930c81aa5 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] No waiting events found dispatching network-vif-plugged-8bb8777b-5b83-47be-ab13-4ad7fd67d66c {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:36:56 user nova-compute[71711]: WARNING nova.compute.manager [req-c7af76e1-10e1-4738-b272-bc9d0cc549d2 req-23aa495a-efab-4d13-8b24-541930c81aa5 service nova] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Received unexpected event network-vif-plugged-8bb8777b-5b83-47be-ab13-4ad7fd67d66c for instance with vm_state deleted and task_state None.
Apr 12 06:36:56 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.154s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:57 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Deleted allocations for instance 3770a397-2124-4648-abad-d3ce6483e3b2
Apr 12 06:36:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-669ded53-3410-4921-be8c-db26caabc99d tempest-SnapshotDataIntegrityTests-2082659614 tempest-SnapshotDataIntegrityTests-2082659614-project-member] Lock "3770a397-2124-4648-abad-d3ce6483e3b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.597s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk 1073741824" returned: 0 in 0.057s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Cannot resize image /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG nova.objects.instance [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'migration_context' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Ensure instance console log exists: /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:57 user nova-compute[71711]: DEBUG nova.network.neutron [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Successfully created port: 4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG nova.network.neutron [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Successfully updated port: 4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquired lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG nova.network.neutron [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-changed-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Refreshing instance network info cache due to event network-changed-4d362992-cbb4-4530-b971-86688508274f. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] Acquiring lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG nova.network.neutron [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:58 user nova-compute[71711]: INFO nova.compute.manager [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Terminating instance
Apr 12 06:36:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-c58b7006-4423-4011-90cb-a3a9aefd98e6 req-6f65d19c-f363-4710-a77b-4f94f9565c5a service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Received event network-vif-unplugged-d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c58b7006-4423-4011-90cb-a3a9aefd98e6 req-6f65d19c-f363-4710-a77b-4f94f9565c5a service nova] Acquiring lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c58b7006-4423-4011-90cb-a3a9aefd98e6 req-6f65d19c-f363-4710-a77b-4f94f9565c5a service nova] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c58b7006-4423-4011-90cb-a3a9aefd98e6 req-6f65d19c-f363-4710-a77b-4f94f9565c5a service nova] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-c58b7006-4423-4011-90cb-a3a9aefd98e6 req-6f65d19c-f363-4710-a77b-4f94f9565c5a service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] No waiting events found dispatching network-vif-unplugged-d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:36:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-c58b7006-4423-4011-90cb-a3a9aefd98e6 req-6f65d19c-f363-4710-a77b-4f94f9565c5a service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Received event network-vif-unplugged-d754ac1a-af83-49a7-8476-727172ee88b1 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.network.neutron [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Updating instance_info_cache with network_info: [{"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Releasing lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Instance network_info: |[{"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] Acquired lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.network.neutron [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Refreshing network info cache for port 4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Start _get_guest_xml network_info=[{"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:36:59 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:36:59 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1904973034',display_name='tempest-ServerRescueNegativeTestJSON-server-1904973034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1904973034',id=30,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVAhwxqVzIlu1Y1+woDzJhr+Sp8DkcWAIkNC1v3bFuM/UHwoGWA8kCbJpxtB+g0Vd0L70GVRFQK6LQHpxQxlm74MgcB1oB68hiKHRg3Ayp2r2eMMg/8ksw6i7RnCnnzag==',key_name='tempest-keypair-4832485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='972842dc32ee4687866dfe2fbefe9cb4',ramdisk_id='',reservation_id='r-k8e58f3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1179647693',owner_user_name='tempest-ServerRescueNegativeTestJSON-1179647693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc8e6af1db834409a4880040a5ef6a5a',uuid=8bd6a08b-ef82-4019-b5d3-7e84cb241eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converting VIF {"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:04:93,bridge_name='br-int',has_traffic_filtering=True,id=4d362992-cbb4-4530-b971-86688508274f,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d362992-cb') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.objects.instance [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:36:59 user nova-compute[71711]:   <uuid>8bd6a08b-ef82-4019-b5d3-7e84cb241eb9</uuid>
Apr 12 06:36:59 user nova-compute[71711]:   <name>instance-0000001e</name>
Apr 12 06:36:59 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:36:59 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:36:59 user nova-compute[71711]:   <metadata>
Apr 12 06:36:59 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:36:59 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:36:59 user nova-compute[71711]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1904973034</nova:name>
Apr 12 06:36:59 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:36:59</nova:creationTime>
Apr 12 06:36:59 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:36:59 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:36:59 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:36:59 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:36:59 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:36:59 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:36:59 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:36:59 user nova-compute[71711]:       <nova:owner>
Apr 12 06:36:59 user nova-compute[71711]:         <nova:user uuid="dc8e6af1db834409a4880040a5ef6a5a">tempest-ServerRescueNegativeTestJSON-1179647693-project-member</nova:user>
Apr 12 06:36:59 user nova-compute[71711]:         <nova:project uuid="972842dc32ee4687866dfe2fbefe9cb4">tempest-ServerRescueNegativeTestJSON-1179647693</nova:project>
Apr 12 06:36:59 user nova-compute[71711]:       </nova:owner>
Apr 12 06:36:59 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:36:59 user nova-compute[71711]:       <nova:ports>
Apr 12 06:36:59 user nova-compute[71711]:         <nova:port uuid="4d362992-cbb4-4530-b971-86688508274f">
Apr 12 06:36:59 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 06:36:59 user nova-compute[71711]:         </nova:port>
Apr 12 06:36:59 user nova-compute[71711]:       </nova:ports>
Apr 12 06:36:59 user nova-compute[71711]:     </nova:instance>
Apr 12 06:36:59 user nova-compute[71711]:   </metadata>
Apr 12 06:36:59 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:36:59 user nova-compute[71711]:     <system>
Apr 12 06:36:59 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:36:59 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:36:59 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:36:59 user nova-compute[71711]:       <entry name="serial">8bd6a08b-ef82-4019-b5d3-7e84cb241eb9</entry>
Apr 12 06:36:59 user nova-compute[71711]:       <entry name="uuid">8bd6a08b-ef82-4019-b5d3-7e84cb241eb9</entry>
Apr 12 06:36:59 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:36:59 user nova-compute[71711]:     </system>
Apr 12 06:36:59 user nova-compute[71711]:   </sysinfo>
Apr 12 06:36:59 user nova-compute[71711]:   <os>
Apr 12 06:36:59 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:36:59 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:36:59 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:36:59 user nova-compute[71711]:   </os>
Apr 12 06:36:59 user nova-compute[71711]:   <features>
Apr 12 06:36:59 user nova-compute[71711]:     <acpi/>
Apr 12 06:36:59 user nova-compute[71711]:     <apic/>
Apr 12 06:36:59 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:36:59 user nova-compute[71711]:   </features>
Apr 12 06:36:59 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:36:59 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:36:59 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:36:59 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:36:59 user nova-compute[71711]:   </clock>
Apr 12 06:36:59 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:36:59 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:36:59 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:36:59 user nova-compute[71711]:   </cpu>
Apr 12 06:36:59 user nova-compute[71711]:   <devices>
Apr 12 06:36:59 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:36:59 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:36:59 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk"/>
Apr 12 06:36:59 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:36:59 user nova-compute[71711]:     </disk>
Apr 12 06:36:59 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:36:59 user nova-compute[71711]:       <mac address="fa:16:3e:18:04:93"/>
Apr 12 06:36:59 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:36:59 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:36:59 user nova-compute[71711]:       <target dev="tap4d362992-cb"/>
Apr 12 06:36:59 user nova-compute[71711]:     </interface>
Apr 12 06:36:59 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:36:59 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/console.log" append="off"/>
Apr 12 06:36:59 user nova-compute[71711]:     </serial>
Apr 12 06:36:59 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:36:59 user nova-compute[71711]:     <video>
Apr 12 06:36:59 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:36:59 user nova-compute[71711]:     </video>
Apr 12 06:36:59 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:36:59 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:36:59 user nova-compute[71711]:     </rng>
Apr 12 06:36:59 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:36:59 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:36:59 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:36:59 user nova-compute[71711]:     </memballoon>
Apr 12 06:36:59 user nova-compute[71711]:   </devices>
Apr 12 06:36:59 user nova-compute[71711]: </domain>
Apr 12 06:36:59 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1904973034',display_name='tempest-ServerRescueNegativeTestJSON-server-1904973034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1904973034',id=30,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVAhwxqVzIlu1Y1+woDzJhr+Sp8DkcWAIkNC1v3bFuM/UHwoGWA8kCbJpxtB+g0Vd0L70GVRFQK6LQHpxQxlm74MgcB1oB68hiKHRg3Ayp2r2eMMg/8ksw6i7RnCnnzag==',key_name='tempest-keypair-4832485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='972842dc32ee4687866dfe2fbefe9cb4',ramdisk_id='',reservation_id='r-k8e58f3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1179647693',owner_user_name='tempest-ServerRescueNegativeTestJSON-1179647693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc8e6af1db834409a4880040a5ef6a5a',uuid=8bd6a08b-ef82-4019-b5d3-7e84cb241eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converting VIF {"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:04:93,bridge_name='br-int',has_traffic_filtering=True,id=4d362992-cbb4-4530-b971-86688508274f,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d362992-cb') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG os_vif [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:04:93,bridge_name='br-int',has_traffic_filtering=True,id=4d362992-cbb4-4530-b971-86688508274f,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d362992-cb') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d362992-cb, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d362992-cb, col_values=(('external_ids', {'iface-id': '4d362992-cbb4-4530-b971-86688508274f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:04:93', 'vm-uuid': '8bd6a08b-ef82-4019-b5d3-7e84cb241eb9'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:59 user nova-compute[71711]: INFO os_vif [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:04:93,bridge_name='br-int',has_traffic_filtering=True,id=4d362992-cbb4-4530-b971-86688508274f,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d362992-cb')
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No VIF found with MAC fa:16:3e:18:04:93, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.network.neutron [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Updated VIF entry in instance network info cache for port 4d362992-cbb4-4530-b971-86688508274f. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.network.neutron [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Updating instance_info_cache with network_info: [{"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-310af456-d3a4-4bcd-9644-176f928d7e52 req-c7c39abf-7dac-4fb4-93ff-073dbed88352 service nova] Releasing lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:36:59 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Instance destroyed successfully.
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.objects.instance [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'resources' on Instance uuid cb572c1a-2901-4b09-920d-e3e0da7765b2 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2019489998',display_name='tempest-AttachVolumeNegativeTest-server-2019489998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2019489998',id=23,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLjxQ88AtZRhXkY0w8AIQaC2BkRU10aHemy0vGFQIJaHfdQnFw5jX788hQrmmL2cfXBPzOBR1uFgPc7i6axEKrPM67paZDd875f3qCLLPV1vMiFyxrryrbMz1BF5WwCng==',key_name='tempest-keypair-2104449008',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b267dce1303d451ca307eeaa38baf685',ramdisk_id='',reservation_id='r-0fit5mx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1905486920',owner_user_name='tempest-AttachVolumeNegativeTest-1905486920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',uuid=cb572c1a-2901-4b09-920d-e3e0da7765b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d754ac1a-af83-49a7-8476-727172ee88b1", "address": "fa:16:3e:94:49:68", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd754ac1a-af", "ovs_interfaceid": "d754ac1a-af83-49a7-8476-727172ee88b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converting VIF {"id": "d754ac1a-af83-49a7-8476-727172ee88b1", "address": "fa:16:3e:94:49:68", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd754ac1a-af", "ovs_interfaceid": "d754ac1a-af83-49a7-8476-727172ee88b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:49:68,bridge_name='br-int',has_traffic_filtering=True,id=d754ac1a-af83-49a7-8476-727172ee88b1,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd754ac1a-af') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG os_vif [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:49:68,bridge_name='br-int',has_traffic_filtering=True,id=d754ac1a-af83-49a7-8476-727172ee88b1,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd754ac1a-af') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd754ac1a-af, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:36:59 user nova-compute[71711]: INFO os_vif [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:49:68,bridge_name='br-int',has_traffic_filtering=True,id=d754ac1a-af83-49a7-8476-727172ee88b1,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd754ac1a-af')
Apr 12 06:36:59 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Deleting instance files /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2_del
Apr 12 06:36:59 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Deletion of /opt/stack/data/nova/instances/cb572c1a-2901-4b09-920d-e3e0da7765b2_del complete
Apr 12 06:36:59 user nova-compute[71711]: INFO nova.compute.manager [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 12 06:36:59 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:36:59 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:37:00 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Took 0.68 seconds to deallocate network for instance.
Apr 12 06:37:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-6ae1c6be-9ead-48c4-9829-36a900a6f50a req-524651f8-1dc7-4890-a610-5d45036f8cb7 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Received event network-vif-deleted-d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-e1eedba9-455a-41f2-84ae-2ae562329c38 req-97cd3386-122a-49cd-82ca-dd848b1bc3bf service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e1eedba9-455a-41f2-84ae-2ae562329c38 req-97cd3386-122a-49cd-82ca-dd848b1bc3bf service nova] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e1eedba9-455a-41f2-84ae-2ae562329c38 req-97cd3386-122a-49cd-82ca-dd848b1bc3bf service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e1eedba9-455a-41f2-84ae-2ae562329c38 req-97cd3386-122a-49cd-82ca-dd848b1bc3bf service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-e1eedba9-455a-41f2-84ae-2ae562329c38 req-97cd3386-122a-49cd-82ca-dd848b1bc3bf service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] No waiting events found dispatching network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:37:00 user nova-compute[71711]: WARNING nova.compute.manager [req-e1eedba9-455a-41f2-84ae-2ae562329c38 req-97cd3386-122a-49cd-82ca-dd848b1bc3bf service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received unexpected event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f for instance with vm_state building and task_state spawning.
Apr 12 06:37:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:00 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Deleted allocations for instance cb572c1a-2901-4b09-920d-e3e0da7765b2
Apr 12 06:37:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-5041f55c-bd8a-4f78-9b2e-1b9ca71c30be req-aaa05090-d01a-4b4c-b9fb-efc9bdf5c1c8 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Received event network-vif-plugged-d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:37:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5041f55c-bd8a-4f78-9b2e-1b9ca71c30be req-aaa05090-d01a-4b4c-b9fb-efc9bdf5c1c8 service nova] Acquiring lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5041f55c-bd8a-4f78-9b2e-1b9ca71c30be req-aaa05090-d01a-4b4c-b9fb-efc9bdf5c1c8 service nova] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5041f55c-bd8a-4f78-9b2e-1b9ca71c30be req-aaa05090-d01a-4b4c-b9fb-efc9bdf5c1c8 service nova] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-5041f55c-bd8a-4f78-9b2e-1b9ca71c30be req-aaa05090-d01a-4b4c-b9fb-efc9bdf5c1c8 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] No waiting events found dispatching network-vif-plugged-d754ac1a-af83-49a7-8476-727172ee88b1 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:37:01 user nova-compute[71711]: WARNING nova.compute.manager [req-5041f55c-bd8a-4f78-9b2e-1b9ca71c30be req-aaa05090-d01a-4b4c-b9fb-efc9bdf5c1c8 service nova] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Received unexpected event network-vif-plugged-d754ac1a-af83-49a7-8476-727172ee88b1 for instance with vm_state deleted and task_state None.
Apr 12 06:37:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-608cfabb-a658-46f7-9ad2-7ac2f4be552c tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "cb572c1a-2901-4b09-920d-e3e0da7765b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.395s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281422.8682292, 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:37:02 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] VM Resumed (Lifecycle Event)
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.compute.manager [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:37:02 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Instance spawned successfully.
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:37:02 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281422.8696015, 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:37:02 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] VM Started (Lifecycle Event)
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:37:02 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:37:02 user nova-compute[71711]: INFO nova.compute.manager [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Took 6.17 seconds to spawn the instance on the hypervisor.
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.compute.manager [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.compute.manager [req-9e3e4012-7699-4cbe-b739-aabf3d190595 req-8cd31e88-3126-4222-b6e4-05144a0d7a4b service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9e3e4012-7699-4cbe-b739-aabf3d190595 req-8cd31e88-3126-4222-b6e4-05144a0d7a4b service nova] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9e3e4012-7699-4cbe-b739-aabf3d190595 req-8cd31e88-3126-4222-b6e4-05144a0d7a4b service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9e3e4012-7699-4cbe-b739-aabf3d190595 req-8cd31e88-3126-4222-b6e4-05144a0d7a4b service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:02 user nova-compute[71711]: DEBUG nova.compute.manager [req-9e3e4012-7699-4cbe-b739-aabf3d190595 req-8cd31e88-3126-4222-b6e4-05144a0d7a4b service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] No waiting events found dispatching network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:37:02 user nova-compute[71711]: WARNING nova.compute.manager [req-9e3e4012-7699-4cbe-b739-aabf3d190595 req-8cd31e88-3126-4222-b6e4-05144a0d7a4b service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received unexpected event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f for instance with vm_state building and task_state spawning.
Apr 12 06:37:03 user nova-compute[71711]: INFO nova.compute.manager [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Took 6.98 seconds to build instance.
Apr 12 06:37:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-30bb3b02-5907-439e-a052-c3f460b9875e tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.073s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:37:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:37:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:37:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:37:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:10 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281415.3324494, 3770a397-2124-4648-abad-d3ce6483e3b2 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:37:10 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] VM Stopped (Lifecycle Event)
Apr 12 06:37:10 user nova-compute[71711]: DEBUG nova.compute.manager [None req-890f24e1-f13c-4a93-8c82-f3a5e4625e83 None None] [instance: 3770a397-2124-4648-abad-d3ce6483e3b2] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:37:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:14 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281419.7633195, cb572c1a-2901-4b09-920d-e3e0da7765b2 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:37:14 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] VM Stopped (Lifecycle Event)
Apr 12 06:37:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-39729d66-573e-4fb9-b107-3e486bedf30a None None] [instance: cb572c1a-2901-4b09-920d-e3e0da7765b2] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:37:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG nova.objects.instance [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'flavor' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:32 user nova-compute[71711]: INFO nova.compute.manager [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Attaching volume ff76495e-eafb-4932-9636-e017f0a60dbf to /dev/vdb
Apr 12 06:37:32 user nova-compute[71711]: DEBUG os_brick.utils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f0a5a6-3eb3-40e0-be7f-6d2ec862b698]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8275b563-5aa7-4c50-a477-85de9d830a11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d515ccb-8e39-435f-8820-a0ffd41395ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c4f075-d381-484b-9c97-ecb968ea08fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:37:32 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:37:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[49124487-f77e-4be6-92b9-09bf47b6bf42]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG os_brick.utils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:37:32 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Updating existing volume attachment record: 17c44b84-7de5-40cc-b13e-1031c4ecba32 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:37:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBTgevpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:37:36 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:37:36 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:37:36 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b71daa-b9cd-4c47-b5c6-190a93e97d53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:37:36 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2111fa2-b217-4cc5-a088-08b6984cc90c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf] added
Apr 12 06:37:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adc4fa9-4115-4ae6-bb6f-fc0b8c047b83]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[75941307-e6cd-4837-8c91-86d235c1fb91]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBTgevpr {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBTgevpr" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f04cdec-2ae0-41ab-8ac9-589df32ace62]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LBTgevpr'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53db221-18bf-4cd2-bb9c-ffea4e110308]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb30b455-1ed9-4148-8eed-93e309677853]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:37:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:37:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4602f9e5-757e-45a8-9cdc-92be72768f8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf, portal: 172.16.0.220,3260]
Apr 12 06:37:36 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf, portal: 172.16.0.220,3260] successful.
Apr 12 06:37:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a2abba-0a9f-44fd-a769-e09d6b7716a4]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f1b7cb-8b96-46f6-b2c9-36db5603567c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:37:36 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:37:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:37:36 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:37:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:37:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:37:37 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:37:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef67223f-d088-4a98-8d4d-f96bfba97aa3]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:37 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:37:38 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:37:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBTgevpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:37:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:37:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23437396238633138', 'path': '/dev/sdc'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:37:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437396238633138', 'path': '/dev/sdc'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:37:38 user nova-compute[71711]: DEBUG nova.objects.instance [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'flavor' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:37:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:37:38 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:37:38 user nova-compute[71711]:   <source dev="/dev/sdc"/>
Apr 12 06:37:38 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:37:38 user nova-compute[71711]:   <serial>ff76495e-eafb-4932-9636-e017f0a60dbf</serial>
Apr 12 06:37:38 user nova-compute[71711]: </disk>
Apr 12 06:37:38 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:37:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:37:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:37:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] No VIF found with MAC fa:16:3e:ba:90:6f, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:37:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-cdc7f369-7856-47a5-9d4b-003d73d845ab tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.229s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:39 user nova-compute[71711]: INFO nova.compute.manager [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Rescuing
Apr 12 06:37:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:37:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquired lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:37:39 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:37:39 user nova-compute[71711]: DEBUG nova.network.neutron [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Updating instance_info_cache with network_info: [{"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:37:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Releasing lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:37:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-e5ad01c4-282b-4d8e-9ea4-98c8fcd8c357 req-a6531f3a-2f52-4638-898d-592e163d7d17 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-unplugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:37:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e5ad01c4-282b-4d8e-9ea4-98c8fcd8c357 req-a6531f3a-2f52-4638-898d-592e163d7d17 service nova] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e5ad01c4-282b-4d8e-9ea4-98c8fcd8c357 req-a6531f3a-2f52-4638-898d-592e163d7d17 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e5ad01c4-282b-4d8e-9ea4-98c8fcd8c357 req-a6531f3a-2f52-4638-898d-592e163d7d17 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-e5ad01c4-282b-4d8e-9ea4-98c8fcd8c357 req-a6531f3a-2f52-4638-898d-592e163d7d17 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] No waiting events found dispatching network-vif-unplugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:37:40 user nova-compute[71711]: WARNING nova.compute.manager [req-e5ad01c4-282b-4d8e-9ea4-98c8fcd8c357 req-a6531f3a-2f52-4638-898d-592e163d7d17 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received unexpected event network-vif-unplugged-f90233ae-9ecb-48be-baf0-7e517849679d for instance with vm_state active and task_state rescuing.
Apr 12 06:37:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:40 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Instance destroyed successfully.
Apr 12 06:37:40 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Attempting a stable device rescue
Apr 12 06:37:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71711) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 06:37:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Instance directory exists: not creating {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 06:37:40 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Creating image(s)
Apr 12 06:37:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "/opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "/opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:40 user nova-compute[71711]: DEBUG nova.objects.instance [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:37:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2.part --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2.part --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG nova.virt.images [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] ba4fcaaf-a4e2-4cbc-9b41-9028e7147906 was qcow2, converting to raw {{(pid=71711) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2.part /opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2.converted {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2.part /opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2.converted" returned: 0 in 0.238s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2.converted --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.077s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2 --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2,backing_fmt=raw /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.rescue {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2,backing_fmt=raw /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.rescue" returned: 0 in 0.053s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG nova.objects.instance [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'migration_context' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Start _get_guest_xml network_info=[{"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "vif_mac": "fa:16:3e:ba:90:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ba4fcaaf-a4e2-4cbc-9b41-9028e7147906', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBTgevpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '4bef2d11-2dfe-47cb-a1ed-3331038ecd99', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff76495e-eafb-4932-9636-e017f0a60dbf', 'serial': 'ff76495e-eafb-4932-9636-e017f0a60dbf'}, 'attachment_id': '17c44b84-7de5-40cc-b13e-1031c4ecba32', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:37:41 user nova-compute[71711]: DEBUG nova.objects.instance [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'resources' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'numa_topology' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:37:42 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:37:42 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBTgevpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:37:42 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:37:42 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:37:42 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ab04a7-e064-476b-a771-cefb4628e511]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LBTgevpr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 06:37:42 user nova-compute[71711]: node.name = iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf
Apr 12 06:37:42 user nova-compute[71711]: node.tpgt = -1
Apr 12 06:37:42 user nova-compute[71711]: node.startup = automatic
Apr 12 06:37:42 user nova-compute[71711]: node.leading_login = No
Apr 12 06:37:42 user nova-compute[71711]: iface.iscsi_ifacename = default
Apr 12 06:37:42 user nova-compute[71711]: iface.net_ifacename = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.ipaddress = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.prefix_len = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.hwaddress = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.transport_name = tcp
Apr 12 06:37:42 user nova-compute[71711]: iface.initiatorname = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.state = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.vlan_id = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.vlan_priority = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.vlan_state = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.iface_num = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.mtu = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.port = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.bootproto = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.subnet_mask = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.gateway = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.dhcp_alt_client_id = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.dhcp_dns = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.dhcp_learn_iqn = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.dhcp_vendor_id_state = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.dhcp_vendor_id = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.dhcp_slp_da = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.fragmentation = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.gratuitous_arp = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.incoming_forwarding = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.tos_state = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.tos = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.ttl = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.delayed_ack = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.tcp_nagle = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.tcp_wsf_state = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.tcp_wsf = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.tcp_timer_scale = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.tcp_timestamp = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.redirect = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.def_task_mgmt_timeout = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.header_digest = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.data_digest = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.immediate_data = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.initial_r2t = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.data_seq_inorder = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.data_pdu_inorder = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.erl = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.max_receive_data_len = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.first_burst_len = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.max_outstanding_r2t = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.max_burst_len = 0
Apr 12 06:37:42 user nova-compute[71711]: iface.chap_auth = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.bidi_chap = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.strict_login_compliance = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.discovery_auth = <empty>
Apr 12 06:37:42 user nova-compute[71711]: iface.discovery_logout = <empty>
Apr 12 06:37:42 user nova-compute[71711]: node.discovery_address = <empty>
Apr 12 06:37:42 user nova-compute[71711]: node.discovery_port = 0
Apr 12 06:37:42 user nova-compute[71711]: node.discovery_type = static
Apr 12 06:37:42 user nova-compute[71711]: node.session.initial_cmdsn = 0
Apr 12 06:37:42 user nova-compute[71711]: node.session.initial_login_retry_max = 8
Apr 12 06:37:42 user nova-compute[71711]: node.session.xmit_thread_priority = -20
Apr 12 06:37:42 user nova-compute[71711]: node.session.cmds_max = 128
Apr 12 06:37:42 user nova-compute[71711]: node.session.queue_depth = 32
Apr 12 06:37:42 user nova-compute[71711]: node.session.nr_sessions = 1
Apr 12 06:37:42 user nova-compute[71711]: node.session.auth.authmethod = CHAP
Apr 12 06:37:42 user nova-compute[71711]: node.session.auth.username = LBTgevpr
Apr 12 06:37:42 user nova-compute[71711]: node.session.auth.password = ***
Apr 12 06:37:42 user nova-compute[71711]: node.session.auth.username_in = <empty>
Apr 12 06:37:42 user nova-compute[71711]: node.session.auth.password_in = <empty>
Apr 12 06:37:42 user nova-compute[71711]: node.session.auth.chap_algs = MD5
Apr 12 06:37:42 user nova-compute[71711]: node.session.timeo.replacement_timeout = 120
Apr 12 06:37:42 user nova-compute[71711]: node.session.err_timeo.abort_timeout = 15
Apr 12 06:37:42 user nova-compute[71711]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 06:37:42 user nova-compute[71711]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 06:37:42 user nova-compute[71711]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 06:37:42 user nova-compute[71711]: node.session.iscsi.FastAbort = Yes
Apr 12 06:37:42 user nova-compute[71711]: node.session.iscsi.InitialR2T = No
Apr 12 06:37:42 user nova-compute[71711]: node.session.iscsi.ImmediateData = Yes
Apr 12 06:37:42 user nova-compute[71711]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 06:37:42 user nova-compute[71711]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 06:37:42 user nova-compute[71711]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 06:37:42 user nova-compute[71711]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 06:37:42 user nova-compute[71711]: node.session.iscsi.MaxConnections = 1
Apr 12 06:37:42 user nova-compute[71711]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 06:37:42 user nova-compute[71711]: node.session.iscsi.ERL = 0
Apr 12 06:37:42 user nova-compute[71711]: node.session.scan = manual
Apr 12 06:37:42 user nova-compute[71711]: node.session.reopen_max = 0
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].address = 172.16.0.220
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].port = 3260
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].startup = manual
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].tcp.window_size = 524288
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].tcp.type_of_service = 0
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].timeo.logout_timeout = 15
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].timeo.login_timeout = 15
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].timeo.auth_timeout = 45
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].iscsi.DataDigest = None
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].iscsi.IFMarker = No
Apr 12 06:37:42 user nova-compute[71711]: node.conn[0].iscsi.OFMarker = No
Apr 12 06:37:42 user nova-compute[71711]: # END RECORD
Apr 12 06:37:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8375e86-662e-4a90-8145-4062e9f3abbb]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aac12c-49bd-46d4-a16d-dc881671709e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBTgevpr {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBTgevpr" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5e0ab6-ef03-4242-aa87-c7cf8d800fee]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LBTgevpr'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-a0983e0d-dac5-458a-823f-034d98da60c8 req-c24a6ef7-755e-4944-9a31-da6baa51ea77 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a0983e0d-dac5-458a-823f-034d98da60c8 req-c24a6ef7-755e-4944-9a31-da6baa51ea77 service nova] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a0983e0d-dac5-458a-823f-034d98da60c8 req-c24a6ef7-755e-4944-9a31-da6baa51ea77 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a0983e0d-dac5-458a-823f-034d98da60c8 req-c24a6ef7-755e-4944-9a31-da6baa51ea77 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-a0983e0d-dac5-458a-823f-034d98da60c8 req-c24a6ef7-755e-4944-9a31-da6baa51ea77 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] No waiting events found dispatching network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:37:42 user nova-compute[71711]: WARNING nova.compute.manager [req-a0983e0d-dac5-458a-823f-034d98da60c8 req-c24a6ef7-755e-4944-9a31-da6baa51ea77 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received unexpected event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d for instance with vm_state active and task_state rescuing.
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b5efa7-d73f-4465-99cd-b92b7001fd30]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[907cfc70-1258-407b-859f-8d067b1fd1bb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:37:42 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:37:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:37:42 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:37:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.140s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] HCTL ('34', '0', '0', 0) found on session 36 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[11639ea9-e29c-4f69-a074-96a64c7d5a5a]: (4, ('0 0 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Searching for a device in session 36 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBTgevpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.163s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] <== connect_volume: return (164ms) {'type': 'block', 'scsi_wwn': '23437396238633138', 'path': '/dev/sdc'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437396238633138', 'path': '/dev/sdc'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:33:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1023741247',display_name='tempest-ServerStableDeviceRescueTest-server-1023741247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1023741247',id=27,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeOfWyak7L55BxU3CMZi8GQ9bZKqJlv/bIHJUXC8z3n705CqYiYWSJdMemQWwpBLyJE0B9ZyBbzqhcedALA6IEN7DJXMfRd9zTiTIeQNDyku00pbbHhb7qWZLZaOCMNzA==',key_name='tempest-keypair-966536347',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:33:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa21d19689b343dd935505ba458dd6af',ramdisk_id='',reservation_id='r-s9xyc36m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-88660584',owner_user_name='tempest-ServerStableDeviceRescueTest-88660584-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:35:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ed0f651f79846138e3be8f312b3188f',uuid=4bef2d11-2dfe-47cb-a1ed-3331038ecd99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "vif_mac": "fa:16:3e:ba:90:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Converting VIF {"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "vif_mac": "fa:16:3e:ba:90:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:90:6f,bridge_name='br-int',has_traffic_filtering=True,id=f90233ae-9ecb-48be-baf0-7e517849679d,network=Network(76d55312-0797-479f-852c-c1b78a76aa90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90233ae-9e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:37:42 user nova-compute[71711]:   <uuid>4bef2d11-2dfe-47cb-a1ed-3331038ecd99</uuid>
Apr 12 06:37:42 user nova-compute[71711]:   <name>instance-0000001b</name>
Apr 12 06:37:42 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:37:42 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:37:42 user nova-compute[71711]:   <metadata>
Apr 12 06:37:42 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:37:42 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:37:42 user nova-compute[71711]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1023741247</nova:name>
Apr 12 06:37:42 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:37:42</nova:creationTime>
Apr 12 06:37:42 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:37:42 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:37:42 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:37:42 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:37:42 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:37:42 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:37:42 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:37:42 user nova-compute[71711]:       <nova:owner>
Apr 12 06:37:42 user nova-compute[71711]:         <nova:user uuid="0ed0f651f79846138e3be8f312b3188f">tempest-ServerStableDeviceRescueTest-88660584-project-member</nova:user>
Apr 12 06:37:42 user nova-compute[71711]:         <nova:project uuid="aa21d19689b343dd935505ba458dd6af">tempest-ServerStableDeviceRescueTest-88660584</nova:project>
Apr 12 06:37:42 user nova-compute[71711]:       </nova:owner>
Apr 12 06:37:42 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:37:42 user nova-compute[71711]:       <nova:ports>
Apr 12 06:37:42 user nova-compute[71711]:         <nova:port uuid="f90233ae-9ecb-48be-baf0-7e517849679d">
Apr 12 06:37:42 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 06:37:42 user nova-compute[71711]:         </nova:port>
Apr 12 06:37:42 user nova-compute[71711]:       </nova:ports>
Apr 12 06:37:42 user nova-compute[71711]:     </nova:instance>
Apr 12 06:37:42 user nova-compute[71711]:   </metadata>
Apr 12 06:37:42 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:37:42 user nova-compute[71711]:     <system>
Apr 12 06:37:42 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:37:42 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:37:42 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:37:42 user nova-compute[71711]:       <entry name="serial">4bef2d11-2dfe-47cb-a1ed-3331038ecd99</entry>
Apr 12 06:37:42 user nova-compute[71711]:       <entry name="uuid">4bef2d11-2dfe-47cb-a1ed-3331038ecd99</entry>
Apr 12 06:37:42 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:37:42 user nova-compute[71711]:     </system>
Apr 12 06:37:42 user nova-compute[71711]:   </sysinfo>
Apr 12 06:37:42 user nova-compute[71711]:   <os>
Apr 12 06:37:42 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:37:42 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:37:42 user nova-compute[71711]:   </os>
Apr 12 06:37:42 user nova-compute[71711]:   <features>
Apr 12 06:37:42 user nova-compute[71711]:     <acpi/>
Apr 12 06:37:42 user nova-compute[71711]:     <apic/>
Apr 12 06:37:42 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:37:42 user nova-compute[71711]:   </features>
Apr 12 06:37:42 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:37:42 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:37:42 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:37:42 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:37:42 user nova-compute[71711]:   </clock>
Apr 12 06:37:42 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:37:42 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:37:42 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:37:42 user nova-compute[71711]:   </cpu>
Apr 12 06:37:42 user nova-compute[71711]:   <devices>
Apr 12 06:37:42 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:37:42 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:37:42 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk"/>
Apr 12 06:37:42 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:37:42 user nova-compute[71711]:     </disk>
Apr 12 06:37:42 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:37:42 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:37:42 user nova-compute[71711]:       <source dev="/dev/sdc"/>
Apr 12 06:37:42 user nova-compute[71711]:       <target dev="vdb" bus="virtio"/>
Apr 12 06:37:42 user nova-compute[71711]:       <serial>ff76495e-eafb-4932-9636-e017f0a60dbf</serial>
Apr 12 06:37:42 user nova-compute[71711]:     </disk>
Apr 12 06:37:42 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:37:42 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:37:42 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.rescue"/>
Apr 12 06:37:42 user nova-compute[71711]:       <target dev="vdc" bus="virtio"/>
Apr 12 06:37:42 user nova-compute[71711]:       <boot order="1"/>
Apr 12 06:37:42 user nova-compute[71711]:     </disk>
Apr 12 06:37:42 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:37:42 user nova-compute[71711]:       <mac address="fa:16:3e:ba:90:6f"/>
Apr 12 06:37:42 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:37:42 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:37:42 user nova-compute[71711]:       <target dev="tapf90233ae-9e"/>
Apr 12 06:37:42 user nova-compute[71711]:     </interface>
Apr 12 06:37:42 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:37:42 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/console.log" append="off"/>
Apr 12 06:37:42 user nova-compute[71711]:     </serial>
Apr 12 06:37:42 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:37:42 user nova-compute[71711]:     <video>
Apr 12 06:37:42 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:37:42 user nova-compute[71711]:     </video>
Apr 12 06:37:42 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:37:42 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:37:42 user nova-compute[71711]:     </rng>
Apr 12 06:37:42 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:37:42 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:37:42 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:37:42 user nova-compute[71711]:     </memballoon>
Apr 12 06:37:42 user nova-compute[71711]:   </devices>
Apr 12 06:37:42 user nova-compute[71711]: </domain>
Apr 12 06:37:42 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:37:42 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Instance destroyed successfully.
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:37:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] No VIF found with MAC fa:16:3e:ba:90:6f, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:37:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-e789d413-6254-4c5b-b717-7f19bb18bb23 req-59994b26-56c4-4d62-abeb-6a34ee62b602 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:37:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e789d413-6254-4c5b-b717-7f19bb18bb23 req-59994b26-56c4-4d62-abeb-6a34ee62b602 service nova] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e789d413-6254-4c5b-b717-7f19bb18bb23 req-59994b26-56c4-4d62-abeb-6a34ee62b602 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e789d413-6254-4c5b-b717-7f19bb18bb23 req-59994b26-56c4-4d62-abeb-6a34ee62b602 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-e789d413-6254-4c5b-b717-7f19bb18bb23 req-59994b26-56c4-4d62-abeb-6a34ee62b602 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] No waiting events found dispatching network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:37:44 user nova-compute[71711]: WARNING nova.compute.manager [req-e789d413-6254-4c5b-b717-7f19bb18bb23 req-59994b26-56c4-4d62-abeb-6a34ee62b602 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received unexpected event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d for instance with vm_state active and task_state rescuing.
Apr 12 06:37:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:37:46 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281466.0124896, 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:37:46 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] VM Resumed (Lifecycle Event)
Apr 12 06:37:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b2a2a80a-9849-41ca-81c6-befd2eb47103 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:37:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:37:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:37:46 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 06:37:46 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281466.0136294, 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:37:46 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] VM Started (Lifecycle Event)
Apr 12 06:37:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:37:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:37:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-062bf35c-6de0-431c-b826-8a345bc54cfd req-0a7cd749-e71b-4b37-ac24-bfa1f11ba9a3 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:37:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-062bf35c-6de0-431c-b826-8a345bc54cfd req-0a7cd749-e71b-4b37-ac24-bfa1f11ba9a3 service nova] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-062bf35c-6de0-431c-b826-8a345bc54cfd req-0a7cd749-e71b-4b37-ac24-bfa1f11ba9a3 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-062bf35c-6de0-431c-b826-8a345bc54cfd req-0a7cd749-e71b-4b37-ac24-bfa1f11ba9a3 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-062bf35c-6de0-431c-b826-8a345bc54cfd req-0a7cd749-e71b-4b37-ac24-bfa1f11ba9a3 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] No waiting events found dispatching network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:37:46 user nova-compute[71711]: WARNING nova.compute.manager [req-062bf35c-6de0-431c-b826-8a345bc54cfd req-0a7cd749-e71b-4b37-ac24-bfa1f11ba9a3 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received unexpected event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d for instance with vm_state rescued and task_state None.
Apr 12 06:37:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:49 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "f93121be-8fbc-4b92-856a-64bf9f192532" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "f93121be-8fbc-4b92-856a-64bf9f192532" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "207359ea-0c81-46aa-a638-276957be0112" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:37:52 user nova-compute[71711]: INFO nova.compute.claims [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Claim successful on node user
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Refreshing inventories for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Updating ProviderTree inventory for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Updating inventory in ProviderTree for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 06:37:52 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Refreshing aggregate associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, aggregates: None {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Refreshing trait associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, traits: HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.688s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:37:53 user nova-compute[71711]: INFO nova.compute.claims [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Claim successful on node user
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG nova.network.neutron [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:37:53 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:37:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG nova.policy [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e5e4455358643b8830ce8c96aad5aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecae91e53ee4d70a8dc24c7febc2a0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:37:53 user nova-compute[71711]: INFO nova.virt.block_device [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Booting with volume-backed-image 4f2549ed-915f-4494-87f3-9269834fa9da at /dev/vda
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Successfully created port: b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:37:54 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:37:54 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8105MB free_disk=26.05398178100586GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:54 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.policy [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance faa2ad52-9528-4013-ad20-4a1d636aed14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance f93121be-8fbc-4b92-856a-64bf9f192532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 207359ea-0c81-46aa-a638-276957be0112 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:37:54 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Creating image(s)
Apr 12 06:37:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "/opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "/opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "/opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.155s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.177s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk 1073741824" returned: 0 in 0.063s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.716s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.149s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Successfully updated port: b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "refresh_cache-207359ea-0c81-46aa-a638-276957be0112" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquired lock "refresh_cache-207359ea-0c81-46aa-a638-276957be0112" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-changed-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Refreshing instance network info cache due to event network-changed-b9933569-0e24-4acb-b85d-ccb1eb9c5721. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] Acquiring lock "refresh_cache-207359ea-0c81-46aa-a638-276957be0112" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Cannot resize image /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'migration_context' on Instance uuid f93121be-8fbc-4b92-856a-64bf9f192532 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Successfully created port: 48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Ensure instance console log exists: /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.network.neutron [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Updating instance_info_cache with network_info: [{"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Releasing lock "refresh_cache-207359ea-0c81-46aa-a638-276957be0112" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.compute.manager [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Instance network_info: |[{"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] Acquired lock "refresh_cache-207359ea-0c81-46aa-a638-276957be0112" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:37:55 user nova-compute[71711]: DEBUG nova.network.neutron [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Refreshing network info cache for port b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Successfully updated port: 48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "refresh_cache-f93121be-8fbc-4b92-856a-64bf9f192532" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquired lock "refresh_cache-f93121be-8fbc-4b92-856a-64bf9f192532" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.network.neutron [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Updated VIF entry in instance network info cache for port b9933569-0e24-4acb-b85d-ccb1eb9c5721. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.network.neutron [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Updating instance_info_cache with network_info: [{"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-14c968b5-8ac3-4dd3-8f4f-ba9e00634a52 req-a2f12ef5-1ea7-42f7-93e1-986c5478b869 service nova] Releasing lock "refresh_cache-207359ea-0c81-46aa-a638-276957be0112" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Skipping network cache update for instance because it is Building. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Skipping network cache update for instance because it is Building. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Received event network-changed-48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Refreshing instance network info cache due to event network-changed-48268378-1f2b-42d7-b20a-631f3de87f6b. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] Acquiring lock "refresh_cache-f93121be-8fbc-4b92-856a-64bf9f192532" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid 0a6c87b7-75d7-429e-9f7b-e8a959f1791f {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Updating instance_info_cache with network_info: [{"id": "48268378-1f2b-42d7-b20a-631f3de87f6b", "address": "fa:16:3e:5e:e5:aa", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48268378-1f", "ovs_interfaceid": "48268378-1f2b-42d7-b20a-631f3de87f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Releasing lock "refresh_cache-f93121be-8fbc-4b92-856a-64bf9f192532" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Instance network_info: |[{"id": "48268378-1f2b-42d7-b20a-631f3de87f6b", "address": "fa:16:3e:5e:e5:aa", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48268378-1f", "ovs_interfaceid": "48268378-1f2b-42d7-b20a-631f3de87f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] Acquired lock "refresh_cache-f93121be-8fbc-4b92-856a-64bf9f192532" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.network.neutron [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Refreshing network info cache for port 48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Start _get_guest_xml network_info=[{"id": "48268378-1f2b-42d7-b20a-631f3de87f6b", "address": "fa:16:3e:5e:e5:aa", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48268378-1f", "ovs_interfaceid": "48268378-1f2b-42d7-b20a-631f3de87f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:37:56 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:37:56 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-724406694',display_name='tempest-AttachVolumeNegativeTest-server-724406694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-724406694',id=31,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEW+augvNasE0Qo/REg3jlWWepgI/HiN9UN+M7OdB1zGToWMOZhc9DuX2ID5abQGOcG4pmVkcHOgGwHKchGMi30PiRS5OZhbYr1bILUuP6EjvFAI3iucPvSzavcZAk3qg==',key_name='tempest-keypair-15797926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b267dce1303d451ca307eeaa38baf685',ramdisk_id='',reservation_id='r-lal9j3j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1905486920',owner_user_name='tempest-AttachVolumeNegativeTest-1905486920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:37:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',uuid=f93121be-8fbc-4b92-856a-64bf9f192532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48268378-1f2b-42d7-b20a-631f3de87f6b", "address": "fa:16:3e:5e:e5:aa", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48268378-1f", "ovs_interfaceid": "48268378-1f2b-42d7-b20a-631f3de87f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converting VIF {"id": "48268378-1f2b-42d7-b20a-631f3de87f6b", "address": "fa:16:3e:5e:e5:aa", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48268378-1f", "ovs_interfaceid": "48268378-1f2b-42d7-b20a-631f3de87f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=48268378-1f2b-42d7-b20a-631f3de87f6b,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48268378-1f') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.objects.instance [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'pci_devices' on Instance uuid f93121be-8fbc-4b92-856a-64bf9f192532 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:37:56 user nova-compute[71711]:   <uuid>f93121be-8fbc-4b92-856a-64bf9f192532</uuid>
Apr 12 06:37:56 user nova-compute[71711]:   <name>instance-0000001f</name>
Apr 12 06:37:56 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:37:56 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:37:56 user nova-compute[71711]:   <metadata>
Apr 12 06:37:56 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:37:56 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:37:56 user nova-compute[71711]:       <nova:name>tempest-AttachVolumeNegativeTest-server-724406694</nova:name>
Apr 12 06:37:56 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:37:56</nova:creationTime>
Apr 12 06:37:56 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:37:56 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:37:56 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:37:56 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:37:56 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:37:56 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:37:56 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:37:56 user nova-compute[71711]:       <nova:owner>
Apr 12 06:37:56 user nova-compute[71711]:         <nova:user uuid="d6cd1f8b3c0d42298f6f4a303f1251ec">tempest-AttachVolumeNegativeTest-1905486920-project-member</nova:user>
Apr 12 06:37:56 user nova-compute[71711]:         <nova:project uuid="b267dce1303d451ca307eeaa38baf685">tempest-AttachVolumeNegativeTest-1905486920</nova:project>
Apr 12 06:37:56 user nova-compute[71711]:       </nova:owner>
Apr 12 06:37:56 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:37:56 user nova-compute[71711]:       <nova:ports>
Apr 12 06:37:56 user nova-compute[71711]:         <nova:port uuid="48268378-1f2b-42d7-b20a-631f3de87f6b">
Apr 12 06:37:56 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 06:37:56 user nova-compute[71711]:         </nova:port>
Apr 12 06:37:56 user nova-compute[71711]:       </nova:ports>
Apr 12 06:37:56 user nova-compute[71711]:     </nova:instance>
Apr 12 06:37:56 user nova-compute[71711]:   </metadata>
Apr 12 06:37:56 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:37:56 user nova-compute[71711]:     <system>
Apr 12 06:37:56 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:37:56 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:37:56 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:37:56 user nova-compute[71711]:       <entry name="serial">f93121be-8fbc-4b92-856a-64bf9f192532</entry>
Apr 12 06:37:56 user nova-compute[71711]:       <entry name="uuid">f93121be-8fbc-4b92-856a-64bf9f192532</entry>
Apr 12 06:37:56 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:37:56 user nova-compute[71711]:     </system>
Apr 12 06:37:56 user nova-compute[71711]:   </sysinfo>
Apr 12 06:37:56 user nova-compute[71711]:   <os>
Apr 12 06:37:56 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:37:56 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:37:56 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:37:56 user nova-compute[71711]:   </os>
Apr 12 06:37:56 user nova-compute[71711]:   <features>
Apr 12 06:37:56 user nova-compute[71711]:     <acpi/>
Apr 12 06:37:56 user nova-compute[71711]:     <apic/>
Apr 12 06:37:56 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:37:56 user nova-compute[71711]:   </features>
Apr 12 06:37:56 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:37:56 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:37:56 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:37:56 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:37:56 user nova-compute[71711]:   </clock>
Apr 12 06:37:56 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:37:56 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:37:56 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:37:56 user nova-compute[71711]:   </cpu>
Apr 12 06:37:56 user nova-compute[71711]:   <devices>
Apr 12 06:37:56 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:37:56 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:37:56 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk"/>
Apr 12 06:37:56 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:37:56 user nova-compute[71711]:     </disk>
Apr 12 06:37:56 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:37:56 user nova-compute[71711]:       <mac address="fa:16:3e:5e:e5:aa"/>
Apr 12 06:37:56 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:37:56 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:37:56 user nova-compute[71711]:       <target dev="tap48268378-1f"/>
Apr 12 06:37:56 user nova-compute[71711]:     </interface>
Apr 12 06:37:56 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:37:56 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/console.log" append="off"/>
Apr 12 06:37:56 user nova-compute[71711]:     </serial>
Apr 12 06:37:56 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:37:56 user nova-compute[71711]:     <video>
Apr 12 06:37:56 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:37:56 user nova-compute[71711]:     </video>
Apr 12 06:37:56 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:37:56 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:37:56 user nova-compute[71711]:     </rng>
Apr 12 06:37:56 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:37:56 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:37:56 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:37:56 user nova-compute[71711]:     </memballoon>
Apr 12 06:37:56 user nova-compute[71711]:   </devices>
Apr 12 06:37:56 user nova-compute[71711]: </domain>
Apr 12 06:37:56 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-724406694',display_name='tempest-AttachVolumeNegativeTest-server-724406694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-724406694',id=31,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEW+augvNasE0Qo/REg3jlWWepgI/HiN9UN+M7OdB1zGToWMOZhc9DuX2ID5abQGOcG4pmVkcHOgGwHKchGMi30PiRS5OZhbYr1bILUuP6EjvFAI3iucPvSzavcZAk3qg==',key_name='tempest-keypair-15797926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b267dce1303d451ca307eeaa38baf685',ramdisk_id='',reservation_id='r-lal9j3j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1905486920',owner_user_name='tempest-AttachVolumeNegativeTest-1905486920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:37:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',uuid=f93121be-8fbc-4b92-856a-64bf9f192532,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48268378-1f2b-42d7-b20a-631f3de87f6b", "address": "fa:16:3e:5e:e5:aa", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48268378-1f", "ovs_interfaceid": "48268378-1f2b-42d7-b20a-631f3de87f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converting VIF {"id": "48268378-1f2b-42d7-b20a-631f3de87f6b", "address": "fa:16:3e:5e:e5:aa", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48268378-1f", "ovs_interfaceid": "48268378-1f2b-42d7-b20a-631f3de87f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=48268378-1f2b-42d7-b20a-631f3de87f6b,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48268378-1f') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG os_vif [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=48268378-1f2b-42d7-b20a-631f3de87f6b,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48268378-1f') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48268378-1f, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48268378-1f, col_values=(('external_ids', {'iface-id': '48268378-1f2b-42d7-b20a-631f3de87f6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:e5:aa', 'vm-uuid': 'f93121be-8fbc-4b92-856a-64bf9f192532'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:56 user nova-compute[71711]: INFO os_vif [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=48268378-1f2b-42d7-b20a-631f3de87f6b,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48268378-1f')
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No VIF found with MAC fa:16:3e:5e:e5:aa, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Updating instance_info_cache with network_info: [{"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:37:57 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:57 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:57 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71711) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 06:37:57 user nova-compute[71711]: DEBUG nova.network.neutron [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Updated VIF entry in instance network info cache for port 48268378-1f2b-42d7-b20a-631f3de87f6b. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:37:57 user nova-compute[71711]: DEBUG nova.network.neutron [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Updating instance_info_cache with network_info: [{"id": "48268378-1f2b-42d7-b20a-631f3de87f6b", "address": "fa:16:3e:5e:e5:aa", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48268378-1f", "ovs_interfaceid": "48268378-1f2b-42d7-b20a-631f3de87f6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:37:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e75e2cd8-6de5-4962-9331-a51fca39ca5f req-ee97123e-8706-491e-bbda-60f3f95e164d service nova] Releasing lock "refresh_cache-f93121be-8fbc-4b92-856a-64bf9f192532" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:37:58 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:37:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 06:37:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] There are 0 instances to clean {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 06:37:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-58ae4740-4b8c-4964-bae5-6c94c067237a req-c81a6b89-a0b0-4aea-9435-b8d81c29ece5 service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Received event network-vif-plugged-48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:37:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-58ae4740-4b8c-4964-bae5-6c94c067237a req-c81a6b89-a0b0-4aea-9435-b8d81c29ece5 service nova] Acquiring lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:37:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-58ae4740-4b8c-4964-bae5-6c94c067237a req-c81a6b89-a0b0-4aea-9435-b8d81c29ece5 service nova] Lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:37:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-58ae4740-4b8c-4964-bae5-6c94c067237a req-c81a6b89-a0b0-4aea-9435-b8d81c29ece5 service nova] Lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:37:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-58ae4740-4b8c-4964-bae5-6c94c067237a req-c81a6b89-a0b0-4aea-9435-b8d81c29ece5 service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] No waiting events found dispatching network-vif-plugged-48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:37:58 user nova-compute[71711]: WARNING nova.compute.manager [req-58ae4740-4b8c-4964-bae5-6c94c067237a req-c81a6b89-a0b0-4aea-9435-b8d81c29ece5 service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Received unexpected event network-vif-plugged-48268378-1f2b-42d7-b20a-631f3de87f6b for instance with vm_state building and task_state spawning.
Apr 12 06:37:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG os_brick.utils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[267b57c3-a6d6-4ae6-a95d-6f400e99d8c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f493326-d970-45bf-927d-5970c0267dd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc0c48e-bb78-4f8f-baed-b55ebfd0ec8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e44ce8-a953-4127-b544-09ae6c146a00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:37:59 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:37:59 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a56a6c-1f03-4ebe-bf72-bd75db01ba0b]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG os_brick.utils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:37:59 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Updating existing volume attachment record: 360e09a9-ce8b-489d-b13f-b0dd5093cd73 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281480.346119, f93121be-8fbc-4b92-856a-64bf9f192532 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:38:00 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] VM Resumed (Lifecycle Event)
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:38:00 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Instance spawned successfully.
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:38:00 user nova-compute[71711]: INFO nova.compute.manager [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Took 5.72 seconds to spawn the instance on the hypervisor.
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:38:00 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281480.3539817, f93121be-8fbc-4b92-856a-64bf9f192532 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:38:00 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] VM Started (Lifecycle Event)
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:38:00 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:38:00 user nova-compute[71711]: INFO nova.compute.manager [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Took 8.08 seconds to build instance.
Apr 12 06:38:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-496593e3-3d63-45d3-9715-ca69f2ca5730 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "f93121be-8fbc-4b92-856a-64bf9f192532" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.202s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-af3cc44d-61ee-4765-bab7-d4a92c9599b1 req-6f899530-3761-4a10-97d3-93166cea4f09 service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Received event network-vif-plugged-48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-af3cc44d-61ee-4765-bab7-d4a92c9599b1 req-6f899530-3761-4a10-97d3-93166cea4f09 service nova] Acquiring lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-af3cc44d-61ee-4765-bab7-d4a92c9599b1 req-6f899530-3761-4a10-97d3-93166cea4f09 service nova] Lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-af3cc44d-61ee-4765-bab7-d4a92c9599b1 req-6f899530-3761-4a10-97d3-93166cea4f09 service nova] Lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-af3cc44d-61ee-4765-bab7-d4a92c9599b1 req-6f899530-3761-4a10-97d3-93166cea4f09 service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] No waiting events found dispatching network-vif-plugged-48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:38:00 user nova-compute[71711]: WARNING nova.compute.manager [req-af3cc44d-61ee-4765-bab7-d4a92c9599b1 req-6f899530-3761-4a10-97d3-93166cea4f09 service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Received unexpected event network-vif-plugged-48268378-1f2b-42d7-b20a-631f3de87f6b for instance with vm_state active and task_state None.
Apr 12 06:38:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.compute.manager [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:38:03 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Creating image(s)
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Ensure instance console log exists: /opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Start _get_guest_xml network_info=[{"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHIBytCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '207359ea-0c81-46aa-a638-276957be0112', 'attached_at': '', 'detached_at': '', 'volume_id': '3b12a713-8214-4892-a05d-c4ae96583b31', 'serial': '3b12a713-8214-4892-a05d-c4ae96583b31'}, 'attachment_id': '360e09a9-ce8b-489d-b13f-b0dd5093cd73', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:38:03 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:38:03 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHIBytCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:38:03 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:38:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:38:03 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:38:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:38:03 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5980e19-abbd-4a84-a153-e244627bfa0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:38:03 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f114d2-4e18-49d5-bbd2-cffd97ea5eb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31] added
Apr 12 06:38:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2574ae-58cf-4eb0-a5fc-6d3af110b610]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[86740108-b66e-4707-b08b-246fc14b3460]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHIBytCb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHIBytCb" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d66a36-aaf4-461e-99cc-8ccdffa32c1d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHIBytCb'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[808899ee-595b-4546-bbe6-c9496455d24a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b26ec7-b610-4579-906e-162bee50ee08]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:38:03 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:38:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:38:03 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:38:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:38:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c4f302-fac3-4b21-8262-0d8aad57ad71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31, portal: 172.16.0.220,3260]
Apr 12 06:38:04 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31, portal: 172.16.0.220,3260] successful.
Apr 12 06:38:04 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a87cd-1eb0-42c0-9e18-a4837b2974f3]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8444d9-b5d5-4c40-91a4-c964a106fe97]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:38:04 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:38:04 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:38:04 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:38:04 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:38:04 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:38:04 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.030s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[774c9d0c-ce25-458c-bbac-2bcff9101a57]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHIBytCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:38:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23439363936323037', 'path': '/dev/sdd'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439363936323037', 'path': '/dev/sdd'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1451717232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1451717232',id=32,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-d5n9p9t2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:37:54Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=207359ea-0c81-46aa-a638-276957be0112,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:b7:30,bridge_name='br-int',has_traffic_filtering=True,id=b9933569-0e24-4acb-b85d-ccb1eb9c5721,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9933569-0e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG nova.objects.instance [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'pci_devices' on Instance uuid 207359ea-0c81-46aa-a638-276957be0112 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:38:05 user nova-compute[71711]:   <uuid>207359ea-0c81-46aa-a638-276957be0112</uuid>
Apr 12 06:38:05 user nova-compute[71711]:   <name>instance-00000020</name>
Apr 12 06:38:05 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:38:05 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:38:05 user nova-compute[71711]:   <metadata>
Apr 12 06:38:05 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:38:05 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:38:05 user nova-compute[71711]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1451717232</nova:name>
Apr 12 06:38:05 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:38:03</nova:creationTime>
Apr 12 06:38:05 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:38:05 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:38:05 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:38:05 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:38:05 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:38:05 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:38:05 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:38:05 user nova-compute[71711]:       <nova:owner>
Apr 12 06:38:05 user nova-compute[71711]:         <nova:user uuid="2e5e4455358643b8830ce8c96aad5aad">tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member</nova:user>
Apr 12 06:38:05 user nova-compute[71711]:         <nova:project uuid="0ecae91e53ee4d70a8dc24c7febc2a0e">tempest-ServerBootFromVolumeStableRescueTest-2063268056</nova:project>
Apr 12 06:38:05 user nova-compute[71711]:       </nova:owner>
Apr 12 06:38:05 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:38:05 user nova-compute[71711]:       <nova:ports>
Apr 12 06:38:05 user nova-compute[71711]:         <nova:port uuid="b9933569-0e24-4acb-b85d-ccb1eb9c5721">
Apr 12 06:38:05 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 06:38:05 user nova-compute[71711]:         </nova:port>
Apr 12 06:38:05 user nova-compute[71711]:       </nova:ports>
Apr 12 06:38:05 user nova-compute[71711]:     </nova:instance>
Apr 12 06:38:05 user nova-compute[71711]:   </metadata>
Apr 12 06:38:05 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:38:05 user nova-compute[71711]:     <system>
Apr 12 06:38:05 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:38:05 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:38:05 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:38:05 user nova-compute[71711]:       <entry name="serial">207359ea-0c81-46aa-a638-276957be0112</entry>
Apr 12 06:38:05 user nova-compute[71711]:       <entry name="uuid">207359ea-0c81-46aa-a638-276957be0112</entry>
Apr 12 06:38:05 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:38:05 user nova-compute[71711]:     </system>
Apr 12 06:38:05 user nova-compute[71711]:   </sysinfo>
Apr 12 06:38:05 user nova-compute[71711]:   <os>
Apr 12 06:38:05 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:38:05 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:38:05 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:38:05 user nova-compute[71711]:   </os>
Apr 12 06:38:05 user nova-compute[71711]:   <features>
Apr 12 06:38:05 user nova-compute[71711]:     <acpi/>
Apr 12 06:38:05 user nova-compute[71711]:     <apic/>
Apr 12 06:38:05 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:38:05 user nova-compute[71711]:   </features>
Apr 12 06:38:05 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:38:05 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:38:05 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:38:05 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:38:05 user nova-compute[71711]:   </clock>
Apr 12 06:38:05 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:38:05 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:38:05 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:38:05 user nova-compute[71711]:   </cpu>
Apr 12 06:38:05 user nova-compute[71711]:   <devices>
Apr 12 06:38:05 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:38:05 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:38:05 user nova-compute[71711]:       <source dev="/dev/sdd"/>
Apr 12 06:38:05 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:38:05 user nova-compute[71711]:       <serial>3b12a713-8214-4892-a05d-c4ae96583b31</serial>
Apr 12 06:38:05 user nova-compute[71711]:     </disk>
Apr 12 06:38:05 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:38:05 user nova-compute[71711]:       <mac address="fa:16:3e:75:b7:30"/>
Apr 12 06:38:05 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:38:05 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:38:05 user nova-compute[71711]:       <target dev="tapb9933569-0e"/>
Apr 12 06:38:05 user nova-compute[71711]:     </interface>
Apr 12 06:38:05 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:38:05 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/console.log" append="off"/>
Apr 12 06:38:05 user nova-compute[71711]:     </serial>
Apr 12 06:38:05 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:38:05 user nova-compute[71711]:     <video>
Apr 12 06:38:05 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:38:05 user nova-compute[71711]:     </video>
Apr 12 06:38:05 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:38:05 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:38:05 user nova-compute[71711]:     </rng>
Apr 12 06:38:05 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:38:05 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:38:05 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:38:05 user nova-compute[71711]:     </memballoon>
Apr 12 06:38:05 user nova-compute[71711]:   </devices>
Apr 12 06:38:05 user nova-compute[71711]: </domain>
Apr 12 06:38:05 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1451717232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1451717232',id=32,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-d5n9p9t2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:37:54Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=207359ea-0c81-46aa-a638-276957be0112,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:b7:30,bridge_name='br-int',has_traffic_filtering=True,id=b9933569-0e24-4acb-b85d-ccb1eb9c5721,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9933569-0e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG os_vif [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:b7:30,bridge_name='br-int',has_traffic_filtering=True,id=b9933569-0e24-4acb-b85d-ccb1eb9c5721,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9933569-0e') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9933569-0e, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9933569-0e, col_values=(('external_ids', {'iface-id': 'b9933569-0e24-4acb-b85d-ccb1eb9c5721', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:b7:30', 'vm-uuid': '207359ea-0c81-46aa-a638-276957be0112'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:05 user nova-compute[71711]: INFO os_vif [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:b7:30,bridge_name='br-int',has_traffic_filtering=True,id=b9933569-0e24-4acb-b85d-ccb1eb9c5721,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9933569-0e')
Apr 12 06:38:05 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:38:05 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No VIF found with MAC fa:16:3e:75:b7:30, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG nova.compute.manager [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Received event network-changed-744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG nova.compute.manager [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Refreshing instance network info cache due to event network-changed-744814ae-b032-41e5-b122-8d5ff605d349. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] Acquiring lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] Acquired lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG nova.network.neutron [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Refreshing network info cache for port 744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG nova.network.neutron [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Updated VIF entry in instance network info cache for port 744814ae-b032-41e5-b122-8d5ff605d349. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG nova.network.neutron [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Updating instance_info_cache with network_info: [{"id": "744814ae-b032-41e5-b122-8d5ff605d349", "address": "fa:16:3e:c2:8c:71", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744814ae-b0", "ovs_interfaceid": "744814ae-b032-41e5-b122-8d5ff605d349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG nova.compute.manager [req-20e7a8d3-e440-41f3-8293-cf88efab6fdc req-670be664-7eef-4607-8951-3434dea487a0 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-20e7a8d3-e440-41f3-8293-cf88efab6fdc req-670be664-7eef-4607-8951-3434dea487a0 service nova] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-20e7a8d3-e440-41f3-8293-cf88efab6fdc req-670be664-7eef-4607-8951-3434dea487a0 service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-20e7a8d3-e440-41f3-8293-cf88efab6fdc req-670be664-7eef-4607-8951-3434dea487a0 service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:06 user nova-compute[71711]: DEBUG nova.compute.manager [req-20e7a8d3-e440-41f3-8293-cf88efab6fdc req-670be664-7eef-4607-8951-3434dea487a0 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] No waiting events found dispatching network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:38:06 user nova-compute[71711]: WARNING nova.compute.manager [req-20e7a8d3-e440-41f3-8293-cf88efab6fdc req-670be664-7eef-4607-8951-3434dea487a0 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received unexpected event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance with vm_state building and task_state spawning.
Apr 12 06:38:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9e24dc9c-504f-444f-b420-082b75286ec4 req-e7798760-f16e-4af4-8371-db0768f2f0fb service nova] Releasing lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281488.842047, 207359ea-0c81-46aa-a638-276957be0112 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:38:08 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] VM Resumed (Lifecycle Event)
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.compute.manager [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:38:08 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 207359ea-0c81-46aa-a638-276957be0112] Instance spawned successfully.
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-07f96996-bc45-4594-8ae7-a50016f9b0ed req-0ae31e7b-5c9f-4ac0-847d-66170cc1c1d7 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-07f96996-bc45-4594-8ae7-a50016f9b0ed req-0ae31e7b-5c9f-4ac0-847d-66170cc1c1d7 service nova] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-07f96996-bc45-4594-8ae7-a50016f9b0ed req-0ae31e7b-5c9f-4ac0-847d-66170cc1c1d7 service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-07f96996-bc45-4594-8ae7-a50016f9b0ed req-0ae31e7b-5c9f-4ac0-847d-66170cc1c1d7 service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-07f96996-bc45-4594-8ae7-a50016f9b0ed req-0ae31e7b-5c9f-4ac0-847d-66170cc1c1d7 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] No waiting events found dispatching network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:38:08 user nova-compute[71711]: WARNING nova.compute.manager [req-07f96996-bc45-4594-8ae7-a50016f9b0ed req-0ae31e7b-5c9f-4ac0-847d-66170cc1c1d7 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received unexpected event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance with vm_state building and task_state spawning.
Apr 12 06:38:08 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281488.8458643, 207359ea-0c81-46aa-a638-276957be0112 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:38:08 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] VM Started (Lifecycle Event)
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:38:08 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:38:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:38:09 user nova-compute[71711]: INFO nova.compute.manager [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Took 5.28 seconds to spawn the instance on the hypervisor.
Apr 12 06:38:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:38:09 user nova-compute[71711]: INFO nova.compute.manager [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Took 16.55 seconds to build instance.
Apr 12 06:38:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-395327ad-8948-4ecc-a818-56e99bba38aa tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "207359ea-0c81-46aa-a638-276957be0112" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.694s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:10 user nova-compute[71711]: DEBUG nova.compute.manager [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:38:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:10 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:38:10 user nova-compute[71711]: INFO nova.compute.claims [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Claim successful on node user
Apr 12 06:38:10 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:38:10 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:38:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:10 user nova-compute[71711]: DEBUG nova.compute.manager [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG nova.network.neutron [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:38:11 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:38:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:38:11 user nova-compute[71711]: INFO nova.virt.block_device [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Booting with volume 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 at /dev/vda
Apr 12 06:38:11 user nova-compute[71711]: DEBUG nova.policy [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad316acdc89947bbba60c75e9a24d7e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54fd87c4105246c1ac1bdf424c83b7aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG os_brick.utils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[94900f1f-77a9-41c5-8162-d6b9b68b4be2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[90be35b7-ad54-4723-94c0-d4f4ae4edda5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc39680b-b2f2-4e6c-81db-ea563e77146f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a1469e-ab77-4535-b79b-d4f6eb4b3dcc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:38:11 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:38:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69b6c65-18df-419e-a53b-53c6e0c94919]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG os_brick.utils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:38:11 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Updating existing volume attachment record: 1d1fd753-b682-4014-a151-aad3a167b5c3 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:38:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Successfully created port: 764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:38:13 user nova-compute[71711]: DEBUG nova.network.neutron [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Successfully updated port: 764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:38:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:38:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquired lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:38:13 user nova-compute[71711]: DEBUG nova.network.neutron [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:38:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received event network-changed-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:38:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Refreshing instance network info cache due to event network-changed-764f8775-3274-4813-97b0-4514b81b7c2e. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:38:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] Acquiring lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:38:13 user nova-compute[71711]: DEBUG nova.network.neutron [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:38:14 user nova-compute[71711]: DEBUG nova.network.neutron [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Updating instance_info_cache with network_info: [{"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:38:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Releasing lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:38:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Instance network_info: |[{"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:38:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] Acquired lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:38:14 user nova-compute[71711]: DEBUG nova.network.neutron [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Refreshing network info cache for port 764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:38:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:14 user nova-compute[71711]: DEBUG nova.network.neutron [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Updated VIF entry in instance network info cache for port 764f8775-3274-4813-97b0-4514b81b7c2e. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:38:14 user nova-compute[71711]: DEBUG nova.network.neutron [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Updating instance_info_cache with network_info: [{"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:38:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-16e63944-8789-421b-8ab0-f87ee21d4390 req-61adb2aa-c076-4d0a-a4fc-5a7e6389033f service nova] Releasing lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:38:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:38:16 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Creating image(s)
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Ensure instance console log exists: /opt/stack/data/nova/instances/51402ffe-ef35-41a3-811b-5a00788a13d8/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Start _get_guest_xml network_info=[{"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIEsORw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '51402ffe-ef35-41a3-811b-5a00788a13d8', 'attached_at': '', 'detached_at': '', 'volume_id': '6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'serial': '6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7'}, 'attachment_id': '1d1fd753-b682-4014-a151-aad3a167b5c3', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:38:16 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:38:16 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIEsORw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:38:16 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:38:16 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:38:16 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2104c177-abaf-46c9-8b1f-a9e868a337dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:38:16 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a1c155-dcb1-45cb-be35-7b0424bb6736]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7] added
Apr 12 06:38:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bd99ae-7af6-4612-a4b7-ee49633a86cb]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c3a8f8-7a8a-4586-ab47-249288a6b2e2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMIEsORw {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMIEsORw" returned: 0 in 0.128s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc9f8b6-d846-4cae-a645-b119a41e1a20]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jMIEsORw'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9b4042-2d48-4caf-a979-8d862e35f46a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7e46a2-436f-4471-b8f6-431707a9160e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:38:16 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:38:16 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:38:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:38:16 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:38:16 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:38:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[48390f51-62a1-48ef-87bc-7c5ed812bdb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260]
Apr 12 06:38:16 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260] successful.
Apr 12 06:38:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[628e93a6-253a-4c91-82b4-3faf37348e78]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4454fc62-47e3-4297-8d45-f076e1f065f9]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:38:16 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:38:16 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:38:16 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:38:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:38:16 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:38:16 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:38:16 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:38:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b223845-cf3e-4fb5-80a1-96bd2ba45f04]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:38:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIEsORw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23861643530663738', 'path': '/dev/sde'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861643530663738', 'path': '/dev/sde'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:38:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2019289684',display_name='tempest-ServerActionsTestJSON-server-2019289684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2019289684',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-6qrxgbgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:38:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=51402ffe-ef35-41a3-811b-5a00788a13d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG nova.objects.instance [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'pci_devices' on Instance uuid 51402ffe-ef35-41a3-811b-5a00788a13d8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:38:17 user nova-compute[71711]:   <uuid>51402ffe-ef35-41a3-811b-5a00788a13d8</uuid>
Apr 12 06:38:17 user nova-compute[71711]:   <name>instance-00000021</name>
Apr 12 06:38:17 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:38:17 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:38:17 user nova-compute[71711]:   <metadata>
Apr 12 06:38:17 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:38:17 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:38:17 user nova-compute[71711]:       <nova:name>tempest-ServerActionsTestJSON-server-2019289684</nova:name>
Apr 12 06:38:17 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:38:16</nova:creationTime>
Apr 12 06:38:17 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:38:17 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:38:17 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:38:17 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:38:17 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:38:17 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:38:17 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:38:17 user nova-compute[71711]:       <nova:owner>
Apr 12 06:38:17 user nova-compute[71711]:         <nova:user uuid="ad316acdc89947bbba60c75e9a24d7e9">tempest-ServerActionsTestJSON-752347644-project-member</nova:user>
Apr 12 06:38:17 user nova-compute[71711]:         <nova:project uuid="54fd87c4105246c1ac1bdf424c83b7aa">tempest-ServerActionsTestJSON-752347644</nova:project>
Apr 12 06:38:17 user nova-compute[71711]:       </nova:owner>
Apr 12 06:38:17 user nova-compute[71711]:       <nova:ports>
Apr 12 06:38:17 user nova-compute[71711]:         <nova:port uuid="764f8775-3274-4813-97b0-4514b81b7c2e">
Apr 12 06:38:17 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:38:17 user nova-compute[71711]:         </nova:port>
Apr 12 06:38:17 user nova-compute[71711]:       </nova:ports>
Apr 12 06:38:17 user nova-compute[71711]:     </nova:instance>
Apr 12 06:38:17 user nova-compute[71711]:   </metadata>
Apr 12 06:38:17 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:38:17 user nova-compute[71711]:     <system>
Apr 12 06:38:17 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:38:17 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:38:17 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:38:17 user nova-compute[71711]:       <entry name="serial">51402ffe-ef35-41a3-811b-5a00788a13d8</entry>
Apr 12 06:38:17 user nova-compute[71711]:       <entry name="uuid">51402ffe-ef35-41a3-811b-5a00788a13d8</entry>
Apr 12 06:38:17 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:38:17 user nova-compute[71711]:     </system>
Apr 12 06:38:17 user nova-compute[71711]:   </sysinfo>
Apr 12 06:38:17 user nova-compute[71711]:   <os>
Apr 12 06:38:17 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:38:17 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:38:17 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:38:17 user nova-compute[71711]:   </os>
Apr 12 06:38:17 user nova-compute[71711]:   <features>
Apr 12 06:38:17 user nova-compute[71711]:     <acpi/>
Apr 12 06:38:17 user nova-compute[71711]:     <apic/>
Apr 12 06:38:17 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:38:17 user nova-compute[71711]:   </features>
Apr 12 06:38:17 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:38:17 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:38:17 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:38:17 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:38:17 user nova-compute[71711]:   </clock>
Apr 12 06:38:17 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:38:17 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:38:17 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:38:17 user nova-compute[71711]:   </cpu>
Apr 12 06:38:17 user nova-compute[71711]:   <devices>
Apr 12 06:38:17 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:38:17 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:38:17 user nova-compute[71711]:       <source dev="/dev/sde"/>
Apr 12 06:38:17 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:38:17 user nova-compute[71711]:       <serial>6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7</serial>
Apr 12 06:38:17 user nova-compute[71711]:     </disk>
Apr 12 06:38:17 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:38:17 user nova-compute[71711]:       <mac address="fa:16:3e:7b:ab:03"/>
Apr 12 06:38:17 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:38:17 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:38:17 user nova-compute[71711]:       <target dev="tap764f8775-32"/>
Apr 12 06:38:17 user nova-compute[71711]:     </interface>
Apr 12 06:38:17 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:38:17 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/51402ffe-ef35-41a3-811b-5a00788a13d8/console.log" append="off"/>
Apr 12 06:38:17 user nova-compute[71711]:     </serial>
Apr 12 06:38:17 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:38:17 user nova-compute[71711]:     <video>
Apr 12 06:38:17 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:38:17 user nova-compute[71711]:     </video>
Apr 12 06:38:17 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:38:17 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:38:17 user nova-compute[71711]:     </rng>
Apr 12 06:38:17 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:38:17 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:38:17 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:38:17 user nova-compute[71711]:     </memballoon>
Apr 12 06:38:17 user nova-compute[71711]:   </devices>
Apr 12 06:38:17 user nova-compute[71711]: </domain>
Apr 12 06:38:17 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:38:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2019289684',display_name='tempest-ServerActionsTestJSON-server-2019289684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2019289684',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-6qrxgbgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:38:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=51402ffe-ef35-41a3-811b-5a00788a13d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG os_vif [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap764f8775-32, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap764f8775-32, col_values=(('external_ids', {'iface-id': '764f8775-3274-4813-97b0-4514b81b7c2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:ab:03', 'vm-uuid': '51402ffe-ef35-41a3-811b-5a00788a13d8'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:17 user nova-compute[71711]: INFO os_vif [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32')
Apr 12 06:38:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:38:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No VIF found with MAC fa:16:3e:7b:ab:03, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:38:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee7213b1-d5da-4564-9937-4184bcf6fc03 req-034a3d89-62c4-4c63-bce7-4d70dfdbfaa1 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received event network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:38:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee7213b1-d5da-4564-9937-4184bcf6fc03 req-034a3d89-62c4-4c63-bce7-4d70dfdbfaa1 service nova] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee7213b1-d5da-4564-9937-4184bcf6fc03 req-034a3d89-62c4-4c63-bce7-4d70dfdbfaa1 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee7213b1-d5da-4564-9937-4184bcf6fc03 req-034a3d89-62c4-4c63-bce7-4d70dfdbfaa1 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee7213b1-d5da-4564-9937-4184bcf6fc03 req-034a3d89-62c4-4c63-bce7-4d70dfdbfaa1 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] No waiting events found dispatching network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:38:19 user nova-compute[71711]: WARNING nova.compute.manager [req-ee7213b1-d5da-4564-9937-4184bcf6fc03 req-034a3d89-62c4-4c63-bce7-4d70dfdbfaa1 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received unexpected event network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e for instance with vm_state building and task_state spawning.
Apr 12 06:38:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281501.1133482, 51402ffe-ef35-41a3-811b-5a00788a13d8 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:38:21 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] VM Resumed (Lifecycle Event)
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:38:21 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Instance spawned successfully.
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:38:21 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281501.1167767, 51402ffe-ef35-41a3-811b-5a00788a13d8 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:38:21 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] VM Started (Lifecycle Event)
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:38:21 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:38:21 user nova-compute[71711]: INFO nova.compute.manager [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Took 5.13 seconds to spawn the instance on the hypervisor.
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:38:21 user nova-compute[71711]: INFO nova.compute.manager [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Took 10.83 seconds to build instance.
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-77938d3a-6e78-4a8d-aeb1-b466a4116aa4 req-f904e04c-4f2c-4f6d-957a-2e0f0a47a185 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received event network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-77938d3a-6e78-4a8d-aeb1-b466a4116aa4 req-f904e04c-4f2c-4f6d-957a-2e0f0a47a185 service nova] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-77938d3a-6e78-4a8d-aeb1-b466a4116aa4 req-f904e04c-4f2c-4f6d-957a-2e0f0a47a185 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-77938d3a-6e78-4a8d-aeb1-b466a4116aa4 req-f904e04c-4f2c-4f6d-957a-2e0f0a47a185 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-77938d3a-6e78-4a8d-aeb1-b466a4116aa4 req-f904e04c-4f2c-4f6d-957a-2e0f0a47a185 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] No waiting events found dispatching network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:38:21 user nova-compute[71711]: WARNING nova.compute.manager [req-77938d3a-6e78-4a8d-aeb1-b466a4116aa4 req-f904e04c-4f2c-4f6d-957a-2e0f0a47a185 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received unexpected event network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e for instance with vm_state active and task_state None.
Apr 12 06:38:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-219845b0-01d8-4e0d-99ed-8248c07da0c4 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.930s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:26 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 0a6c87b7-75d7-429e-9f7b-e8a959f1791f {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 5364688b-cc08-4407-94f5-974846ae7bb8 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid c64aff93-15fa-4520-b6ac-cdcacb49478e {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid ebb36f74-c4a3-4108-949d-1fb8918f9a8c {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid faa2ad52-9528-4013-ad20-4a1d636aed14 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 659489bb-3672-4f70-9ab5-b37f310a7d86 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid f93121be-8fbc-4b92-856a-64bf9f192532 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 207359ea-0c81-46aa-a638-276957be0112 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 51402ffe-ef35-41a3-811b-5a00788a13d8 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "5364688b-cc08-4407-94f5-974846ae7bb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "c64aff93-15fa-4520-b6ac-cdcacb49478e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "faa2ad52-9528-4013-ad20-4a1d636aed14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "659489bb-3672-4f70-9ab5-b37f310a7d86" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "f93121be-8fbc-4b92-856a-64bf9f192532" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "f93121be-8fbc-4b92-856a-64bf9f192532" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "207359ea-0c81-46aa-a638-276957be0112" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "5364688b-cc08-4407-94f5-974846ae7bb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "f93121be-8fbc-4b92-856a-64bf9f192532" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "207359ea-0c81-46aa-a638-276957be0112" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-changed-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:38:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Refreshing instance network info cache due to event network-changed-4d362992-cbb4-4530-b971-86688508274f. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:38:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] Acquiring lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:38:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] Acquired lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:38:46 user nova-compute[71711]: DEBUG nova.network.neutron [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Refreshing network info cache for port 4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:38:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:46 user nova-compute[71711]: DEBUG nova.objects.instance [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'flavor' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:38:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:47 user nova-compute[71711]: INFO nova.compute.manager [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Attaching volume 4e3910db-ed08-4a5a-bb85-48c49eccbf9a to /dev/vdb
Apr 12 06:38:47 user nova-compute[71711]: DEBUG os_brick.utils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d626fa-ff9c-460c-89c3-20a1ed2cc8c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffb4a05-fd97-4f85-b686-f3f9c5f60fdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG nova.network.neutron [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Updated VIF entry in instance network info cache for port 4d362992-cbb4-4530-b971-86688508274f. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG nova.network.neutron [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Updating instance_info_cache with network_info: [{"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aa1481-a3f2-4193-8538-541fa0e9a6bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[16709abc-286b-445f-8a75-1b440e17dfa2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-277722f8-2757-46f8-be46-9a754a0843e7 req-27183dd6-81ef-4475-bab8-76ad50578f24 service nova] Releasing lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:38:47 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:38:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff8ed1d-9867-4986-88b0-ee0b6fa93f93]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG os_brick.utils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Updating existing volume attachment record: 40508e3c-269e-4d91-87cd-befd0381b757 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:38:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:50 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NilzYZIx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:38:51 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:38:51 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:38:51 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1656cb-d2e0-4592-b8e8-271c453d0cfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:38:51 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e67f865-d613-4e50-b179-0b9db0690317]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a] added
Apr 12 06:38:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38faad0-a36e-4f48-815e-586acbed561d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb57248-28a0-40b1-a77a-096a9498f603]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NilzYZIx {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NilzYZIx" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9581f2ca-9ea7-4b0b-a382-076a2d77d667]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NilzYZIx'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d79bcc1-220c-40a3-b6a3-df2d38f5f68a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d183a6a-676d-43c4-a3ef-c563d35f5426]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:38:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:38:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[606b4e13-de7b-4109-96eb-6b586667c916]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a, portal: 172.16.0.220,3260]
Apr 12 06:38:51 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a, portal: 172.16.0.220,3260] successful.
Apr 12 06:38:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a494f48-a146-4901-a7f1-86ae038be490]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[909bb0ca-de19-4e30-b3ea-a7f619a97ef1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:38:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:38:51 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:38:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff908aee-78a3-493d-838d-4d33f0ff72a2]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:38:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NilzYZIx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:38:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:38:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26338353737343134', 'path': '/dev/sdf'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:38:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338353737343134', 'path': '/dev/sdf'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:38:52 user nova-compute[71711]: DEBUG nova.objects.instance [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'flavor' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:38:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:38:52 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:38:52 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:38:52 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:38:52 user nova-compute[71711]:   <serial>4e3910db-ed08-4a5a-bb85-48c49eccbf9a</serial>
Apr 12 06:38:52 user nova-compute[71711]: </disk>
Apr 12 06:38:52 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No VIF found with MAC fa:16:3e:18:04:93, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f6734b2a-365e-4433-8330-8bd8941fd777 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.363s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:53 user nova-compute[71711]: INFO nova.compute.manager [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Rescuing
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquired lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:38:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Updating instance_info_cache with network_info: [{"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Releasing lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-35a17a41-63b1-46a2-abfc-b1693a062674 req-1209c22f-4fca-4514-a46c-12c61e1a5ee6 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-unplugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-35a17a41-63b1-46a2-abfc-b1693a062674 req-1209c22f-4fca-4514-a46c-12c61e1a5ee6 service nova] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-35a17a41-63b1-46a2-abfc-b1693a062674 req-1209c22f-4fca-4514-a46c-12c61e1a5ee6 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-35a17a41-63b1-46a2-abfc-b1693a062674 req-1209c22f-4fca-4514-a46c-12c61e1a5ee6 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-35a17a41-63b1-46a2-abfc-b1693a062674 req-1209c22f-4fca-4514-a46c-12c61e1a5ee6 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] No waiting events found dispatching network-vif-unplugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:38:54 user nova-compute[71711]: WARNING nova.compute.manager [req-35a17a41-63b1-46a2-abfc-b1693a062674 req-1209c22f-4fca-4514-a46c-12c61e1a5ee6 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received unexpected event network-vif-unplugged-4d362992-cbb4-4530-b971-86688508274f for instance with vm_state active and task_state rescuing.
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:55 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Instance destroyed successfully.
Apr 12 06:38:55 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Attempting rescue
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71711) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Instance directory exists: not creating {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 06:38:55 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Creating image(s)
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "/opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "/opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.128s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.rescue {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.rescue" returned: 0 in 0.048s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'migration_context' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Start _get_guest_xml network_info=[{"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "vif_mac": "fa:16:3e:18:04:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'resources' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'numa_topology' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:38:55 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:38:55 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1904973034',display_name='tempest-ServerRescueNegativeTestJSON-server-1904973034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1904973034',id=30,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVAhwxqVzIlu1Y1+woDzJhr+Sp8DkcWAIkNC1v3bFuM/UHwoGWA8kCbJpxtB+g0Vd0L70GVRFQK6LQHpxQxlm74MgcB1oB68hiKHRg3Ayp2r2eMMg/8ksw6i7RnCnnzag==',key_name='tempest-keypair-4832485',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:37:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='972842dc32ee4687866dfe2fbefe9cb4',ramdisk_id='',reservation_id='r-k8e58f3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1179647693',owner_user_name='tempest-ServerRescueNegativeTestJSON-1179647693-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc8e6af1db834409a4880040a5ef6a5a',uuid=8bd6a08b-ef82-4019-b5d3-7e84cb241eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "vif_mac": "fa:16:3e:18:04:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converting VIF {"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "vif_mac": "fa:16:3e:18:04:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:04:93,bridge_name='br-int',has_traffic_filtering=True,id=4d362992-cbb4-4530-b971-86688508274f,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d362992-cb') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:38:55 user nova-compute[71711]:   <uuid>8bd6a08b-ef82-4019-b5d3-7e84cb241eb9</uuid>
Apr 12 06:38:55 user nova-compute[71711]:   <name>instance-0000001e</name>
Apr 12 06:38:55 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:38:55 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:38:55 user nova-compute[71711]:   <metadata>
Apr 12 06:38:55 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:38:55 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:38:55 user nova-compute[71711]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1904973034</nova:name>
Apr 12 06:38:55 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:38:55</nova:creationTime>
Apr 12 06:38:55 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:38:55 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:38:55 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:38:55 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:38:55 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:38:55 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:38:55 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:38:55 user nova-compute[71711]:       <nova:owner>
Apr 12 06:38:55 user nova-compute[71711]:         <nova:user uuid="dc8e6af1db834409a4880040a5ef6a5a">tempest-ServerRescueNegativeTestJSON-1179647693-project-member</nova:user>
Apr 12 06:38:55 user nova-compute[71711]:         <nova:project uuid="972842dc32ee4687866dfe2fbefe9cb4">tempest-ServerRescueNegativeTestJSON-1179647693</nova:project>
Apr 12 06:38:55 user nova-compute[71711]:       </nova:owner>
Apr 12 06:38:55 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:38:55 user nova-compute[71711]:       <nova:ports>
Apr 12 06:38:55 user nova-compute[71711]:         <nova:port uuid="4d362992-cbb4-4530-b971-86688508274f">
Apr 12 06:38:55 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 06:38:55 user nova-compute[71711]:         </nova:port>
Apr 12 06:38:55 user nova-compute[71711]:       </nova:ports>
Apr 12 06:38:55 user nova-compute[71711]:     </nova:instance>
Apr 12 06:38:55 user nova-compute[71711]:   </metadata>
Apr 12 06:38:55 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:38:55 user nova-compute[71711]:     <system>
Apr 12 06:38:55 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:38:55 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:38:55 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:38:55 user nova-compute[71711]:       <entry name="serial">8bd6a08b-ef82-4019-b5d3-7e84cb241eb9</entry>
Apr 12 06:38:55 user nova-compute[71711]:       <entry name="uuid">8bd6a08b-ef82-4019-b5d3-7e84cb241eb9</entry>
Apr 12 06:38:55 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:38:55 user nova-compute[71711]:     </system>
Apr 12 06:38:55 user nova-compute[71711]:   </sysinfo>
Apr 12 06:38:55 user nova-compute[71711]:   <os>
Apr 12 06:38:55 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:38:55 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:38:55 user nova-compute[71711]:   </os>
Apr 12 06:38:55 user nova-compute[71711]:   <features>
Apr 12 06:38:55 user nova-compute[71711]:     <acpi/>
Apr 12 06:38:55 user nova-compute[71711]:     <apic/>
Apr 12 06:38:55 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:38:55 user nova-compute[71711]:   </features>
Apr 12 06:38:55 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:38:55 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:38:55 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:38:55 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:38:55 user nova-compute[71711]:   </clock>
Apr 12 06:38:55 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:38:55 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:38:55 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:38:55 user nova-compute[71711]:   </cpu>
Apr 12 06:38:55 user nova-compute[71711]:   <devices>
Apr 12 06:38:55 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:38:55 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:38:55 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.rescue"/>
Apr 12 06:38:55 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:38:55 user nova-compute[71711]:     </disk>
Apr 12 06:38:55 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:38:55 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:38:55 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk"/>
Apr 12 06:38:55 user nova-compute[71711]:       <target dev="vdb" bus="virtio"/>
Apr 12 06:38:55 user nova-compute[71711]:     </disk>
Apr 12 06:38:55 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:38:55 user nova-compute[71711]:       <mac address="fa:16:3e:18:04:93"/>
Apr 12 06:38:55 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:38:55 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:38:55 user nova-compute[71711]:       <target dev="tap4d362992-cb"/>
Apr 12 06:38:55 user nova-compute[71711]:     </interface>
Apr 12 06:38:55 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:38:55 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/console.log" append="off"/>
Apr 12 06:38:55 user nova-compute[71711]:     </serial>
Apr 12 06:38:55 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:38:55 user nova-compute[71711]:     <video>
Apr 12 06:38:55 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:38:55 user nova-compute[71711]:     </video>
Apr 12 06:38:55 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:38:55 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:38:55 user nova-compute[71711]:     </rng>
Apr 12 06:38:55 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:38:55 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:38:55 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:38:55 user nova-compute[71711]:     </memballoon>
Apr 12 06:38:55 user nova-compute[71711]:   </devices>
Apr 12 06:38:55 user nova-compute[71711]: </domain>
Apr 12 06:38:55 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:38:55 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Instance destroyed successfully.
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] No VIF found with MAC fa:16:3e:18:04:93, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-e15f53cd-079e-4189-b77d-5527ef68d969 req-3220e022-fbbf-4d60-b3d6-90a8827ef928 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:38:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15f53cd-079e-4189-b77d-5527ef68d969 req-3220e022-fbbf-4d60-b3d6-90a8827ef928 service nova] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15f53cd-079e-4189-b77d-5527ef68d969 req-3220e022-fbbf-4d60-b3d6-90a8827ef928 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e15f53cd-079e-4189-b77d-5527ef68d969 req-3220e022-fbbf-4d60-b3d6-90a8827ef928 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-e15f53cd-079e-4189-b77d-5527ef68d969 req-3220e022-fbbf-4d60-b3d6-90a8827ef928 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] No waiting events found dispatching network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:38:56 user nova-compute[71711]: WARNING nova.compute.manager [req-e15f53cd-079e-4189-b77d-5527ef68d969 req-3220e022-fbbf-4d60-b3d6-90a8827ef928 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received unexpected event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f for instance with vm_state active and task_state rescuing.
Apr 12 06:38:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:38:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:38:57 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:38:57 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:38:58 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:38:58 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7777MB free_disk=26.021442413330078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance faa2ad52-9528-4013-ad20-4a1d636aed14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance f93121be-8fbc-4b92-856a-64bf9f192532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 207359ea-0c81-46aa-a638-276957be0112 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] No waiting events found dispatching network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:38:58 user nova-compute[71711]: WARNING nova.compute.manager [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received unexpected event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f for instance with vm_state active and task_state rescuing.
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:38:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] No waiting events found dispatching network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:38:58 user nova-compute[71711]: WARNING nova.compute.manager [req-ea012055-b9a5-4122-8455-8cb9ac5a7606 req-de027a10-0d29-44d5-b889-0cfdc039f212 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received unexpected event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f for instance with vm_state active and task_state rescuing.
Apr 12 06:38:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:38:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:38:59 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281539.3687239, 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:38:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] VM Resumed (Lifecycle Event)
Apr 12 06:38:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a0eb44a0-07c9-404e-83c7-120bae072466 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:38:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:38:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:38:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 06:38:59 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281539.3704047, 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:38:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] VM Started (Lifecycle Event)
Apr 12 06:38:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:38:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:38:59 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:38:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:38:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:38:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:38:59 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:39:00 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Updating instance_info_cache with network_info: [{"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:39:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-5364688b-cc08-4407-94f5-974846ae7bb8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:39:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:39:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:39:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:39:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:39:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:39:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:39:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:39:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:29 user nova-compute[71711]: INFO nova.compute.manager [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Unrescuing
Apr 12 06:39:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:39:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquired lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:39:29 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:39:30 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Updating instance_info_cache with network_info: [{"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Releasing lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG nova.objects.instance [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'flavor' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG nova.compute.manager [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-changed-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG nova.compute.manager [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Refreshing instance network info cache due to event network-changed-f90233ae-9ecb-48be-baf0-7e517849679d. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] Acquiring lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] Acquired lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG nova.network.neutron [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Refreshing network info cache for port f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG nova.compute.manager [req-ae580b73-9f44-40f7-96e6-646e7326784d req-4acec91f-05fd-406e-bf0a-3f791c9117e4 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-unplugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ae580b73-9f44-40f7-96e6-646e7326784d req-4acec91f-05fd-406e-bf0a-3f791c9117e4 service nova] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ae580b73-9f44-40f7-96e6-646e7326784d req-4acec91f-05fd-406e-bf0a-3f791c9117e4 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ae580b73-9f44-40f7-96e6-646e7326784d req-4acec91f-05fd-406e-bf0a-3f791c9117e4 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG nova.compute.manager [req-ae580b73-9f44-40f7-96e6-646e7326784d req-4acec91f-05fd-406e-bf0a-3f791c9117e4 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] No waiting events found dispatching network-vif-unplugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:39:31 user nova-compute[71711]: WARNING nova.compute.manager [req-ae580b73-9f44-40f7-96e6-646e7326784d req-4acec91f-05fd-406e-bf0a-3f791c9117e4 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received unexpected event network-vif-unplugged-f90233ae-9ecb-48be-baf0-7e517849679d for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:39:31 user nova-compute[71711]: DEBUG nova.network.neutron [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Updated VIF entry in instance network info cache for port f90233ae-9ecb-48be-baf0-7e517849679d. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG nova.network.neutron [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Updating instance_info_cache with network_info: [{"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:39:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-21b3a5d3-02d4-4351-865a-ede6eeaf5a48 req-0771536a-012e-4d78-b127-4a0646cb268e service nova] Releasing lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:39:31 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Instance destroyed successfully.
Apr 12 06:39:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-changed-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Refreshing instance network info cache due to event network-changed-f90233ae-9ecb-48be-baf0-7e517849679d. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] Acquiring lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] Acquired lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG nova.network.neutron [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Refreshing network info cache for port f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] No waiting events found dispatching network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:39:33 user nova-compute[71711]: WARNING nova.compute.manager [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received unexpected event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:39:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] No waiting events found dispatching network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:39:33 user nova-compute[71711]: WARNING nova.compute.manager [req-a299de18-7b96-4baa-a094-333740808466 req-75b1e142-a086-40af-b815-2639ff50067c service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received unexpected event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:39:33 user nova-compute[71711]: DEBUG nova.network.neutron [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Updated VIF entry in instance network info cache for port f90233ae-9ecb-48be-baf0-7e517849679d. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG nova.network.neutron [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Updating instance_info_cache with network_info: [{"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-da5ce286-a053-49d6-afff-ed15e2089317 req-89dd71d8-5add-4657-b98a-f060e382d972 service nova] Releasing lock "refresh_cache-4bef2d11-2dfe-47cb-a1ed-3331038ecd99" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:35 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:39:35 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281575.3862274, 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:39:35 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] VM Resumed (Lifecycle Event)
Apr 12 06:39:35 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d0afe2ba-ba53-4d30-8d47-3eb093043ac7 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:39:35 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:39:35 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:39:35 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 06:39:35 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281575.3900483, 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:39:35 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] VM Started (Lifecycle Event)
Apr 12 06:39:35 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:39:35 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:39:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-2240dc9b-66f5-4d8c-b340-7e230ce6f101 req-427cf22a-85cc-4227-8c57-028f3028f12b service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:39:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2240dc9b-66f5-4d8c-b340-7e230ce6f101 req-427cf22a-85cc-4227-8c57-028f3028f12b service nova] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2240dc9b-66f5-4d8c-b340-7e230ce6f101 req-427cf22a-85cc-4227-8c57-028f3028f12b service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2240dc9b-66f5-4d8c-b340-7e230ce6f101 req-427cf22a-85cc-4227-8c57-028f3028f12b service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-2240dc9b-66f5-4d8c-b340-7e230ce6f101 req-427cf22a-85cc-4227-8c57-028f3028f12b service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] No waiting events found dispatching network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:39:35 user nova-compute[71711]: WARNING nova.compute.manager [req-2240dc9b-66f5-4d8c-b340-7e230ce6f101 req-427cf22a-85cc-4227-8c57-028f3028f12b service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received unexpected event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d for instance with vm_state active and task_state None.
Apr 12 06:39:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:43 user nova-compute[71711]: INFO nova.compute.manager [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Rescuing
Apr 12 06:39:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "refresh_cache-207359ea-0c81-46aa-a638-276957be0112" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquired lock "refresh_cache-207359ea-0c81-46aa-a638-276957be0112" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG nova.network.neutron [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Received event network-changed-48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Refreshing instance network info cache due to event network-changed-48268378-1f2b-42d7-b20a-631f3de87f6b. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] Acquiring lock "refresh_cache-f93121be-8fbc-4b92-856a-64bf9f192532" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] Acquired lock "refresh_cache-f93121be-8fbc-4b92-856a-64bf9f192532" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG nova.network.neutron [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Refreshing network info cache for port 48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG nova.network.neutron [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Updating instance_info_cache with network_info: [{"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Releasing lock "refresh_cache-207359ea-0c81-46aa-a638-276957be0112" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG nova.network.neutron [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Updated VIF entry in instance network info cache for port 48268378-1f2b-42d7-b20a-631f3de87f6b. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG nova.network.neutron [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Updating instance_info_cache with network_info: [{"id": "48268378-1f2b-42d7-b20a-631f3de87f6b", "address": "fa:16:3e:5e:e5:aa", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48268378-1f", "ovs_interfaceid": "48268378-1f2b-42d7-b20a-631f3de87f6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3c075b5c-3be7-4921-8210-612805aaddc3 req-c1fbe8cd-d7d6-4823-b80f-6d057277312c service nova] Releasing lock "refresh_cache-f93121be-8fbc-4b92-856a-64bf9f192532" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-710743a2-5d28-4425-b9a6-46615b191881 req-396f1685-309a-4d7f-bc33-f23aee26c6e9 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-unplugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-710743a2-5d28-4425-b9a6-46615b191881 req-396f1685-309a-4d7f-bc33-f23aee26c6e9 service nova] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-710743a2-5d28-4425-b9a6-46615b191881 req-396f1685-309a-4d7f-bc33-f23aee26c6e9 service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-710743a2-5d28-4425-b9a6-46615b191881 req-396f1685-309a-4d7f-bc33-f23aee26c6e9 service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-710743a2-5d28-4425-b9a6-46615b191881 req-396f1685-309a-4d7f-bc33-f23aee26c6e9 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] No waiting events found dispatching network-vif-unplugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:39:43 user nova-compute[71711]: WARNING nova.compute.manager [req-710743a2-5d28-4425-b9a6-46615b191881 req-396f1685-309a-4d7f-bc33-f23aee26c6e9 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received unexpected event network-vif-unplugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance with vm_state active and task_state rescuing.
Apr 12 06:39:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 207359ea-0c81-46aa-a638-276957be0112] Instance destroyed successfully.
Apr 12 06:39:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Attempting a stable device rescue
Apr 12 06:39:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71711) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 06:39:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Instance directory exists: not creating {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 06:39:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Creating image(s)
Apr 12 06:39:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "/opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "/opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "/opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:44 user nova-compute[71711]: DEBUG nova.objects.instance [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'trusted_certs' on Instance uuid 207359ea-0c81-46aa-a638-276957be0112 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:39:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "9878d41a27876d5767eebf67d331e3d033b27218" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "9878d41a27876d5767eebf67d331e3d033b27218" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218.part --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "f93121be-8fbc-4b92-856a-64bf9f192532" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "f93121be-8fbc-4b92-856a-64bf9f192532" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:45 user nova-compute[71711]: DEBUG nova.objects.instance [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'flavor' on Instance uuid f93121be-8fbc-4b92-856a-64bf9f192532 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:39:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "f93121be-8fbc-4b92-856a-64bf9f192532" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218.part --force-share --output=json" returned: 0 in 0.186s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:45 user nova-compute[71711]: DEBUG nova.virt.images [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] 31d56266-ff18-4fd7-b5f7-57502c4c2e1e was qcow2, converting to raw {{(pid=71711) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 06:39:45 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:39:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218.part /opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218.converted {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "f93121be-8fbc-4b92-856a-64bf9f192532" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "f93121be-8fbc-4b92-856a-64bf9f192532" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:46 user nova-compute[71711]: INFO nova.compute.manager [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Attaching volume a7204ed1-e658-42f0-b1fd-590e8b56f1f5 to /dev/vdb
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-15cca0dc-2969-4777-ab62-181938613e90 req-d760d5df-d628-4874-b165-6178a6b06f5e service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-15cca0dc-2969-4777-ab62-181938613e90 req-d760d5df-d628-4874-b165-6178a6b06f5e service nova] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-15cca0dc-2969-4777-ab62-181938613e90 req-d760d5df-d628-4874-b165-6178a6b06f5e service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-15cca0dc-2969-4777-ab62-181938613e90 req-d760d5df-d628-4874-b165-6178a6b06f5e service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-15cca0dc-2969-4777-ab62-181938613e90 req-d760d5df-d628-4874-b165-6178a6b06f5e service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] No waiting events found dispatching network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:39:46 user nova-compute[71711]: WARNING nova.compute.manager [req-15cca0dc-2969-4777-ab62-181938613e90 req-d760d5df-d628-4874-b165-6178a6b06f5e service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received unexpected event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance with vm_state active and task_state rescuing.
Apr 12 06:39:46 user nova-compute[71711]: DEBUG os_brick.utils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b1b618-5daf-4d9c-8742-97ffd7d579f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.033s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d577a74-7667-4c4a-ae52-844609ae0dd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[08913dfa-248c-4043-9afa-ab75b947c42d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d52813e-d8c8-4ed0-91e9-b4ea03a3a175]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:39:46 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ad3235-3bf1-46dc-8b71-2077e6af30a9]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG os_brick.utils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Updating existing volume attachment record: 148fc50c-84ee-453f-90a5-ef24d0d03543 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218.part /opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218.converted" returned: 0 in 0.558s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218.converted --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "9878d41a27876d5767eebf67d331e3d033b27218" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.015s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "9878d41a27876d5767eebf67d331e3d033b27218" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "9878d41a27876d5767eebf67d331e3d033b27218" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218 --force-share --output=json" returned: 0 in 0.165s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218,backing_fmt=raw /opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.rescue {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218,backing_fmt=raw /opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.rescue" returned: 0 in 0.058s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "9878d41a27876d5767eebf67d331e3d033b27218" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.objects.instance [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'migration_context' on Instance uuid 207359ea-0c81-46aa-a638-276957be0112 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Start _get_guest_xml network_info=[{"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "vif_mac": "fa:16:3e:75:b7:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '31d56266-ff18-4fd7-b5f7-57502c4c2e1e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHIBytCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '207359ea-0c81-46aa-a638-276957be0112', 'attached_at': '', 'detached_at': '', 'volume_id': '3b12a713-8214-4892-a05d-c4ae96583b31', 'serial': '3b12a713-8214-4892-a05d-c4ae96583b31'}, 'attachment_id': '360e09a9-ce8b-489d-b13f-b0dd5093cd73', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.objects.instance [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'resources' on Instance uuid 207359ea-0c81-46aa-a638-276957be0112 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.objects.instance [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'numa_topology' on Instance uuid 207359ea-0c81-46aa-a638-276957be0112 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:39:46 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:39:46 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.objects.instance [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'vcpu_model' on Instance uuid 207359ea-0c81-46aa-a638-276957be0112 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHIBytCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:39:46 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:39:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:39:46 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:39:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:39:46 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:39:46 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:39:46 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8476cc-fcb1-4178-aea6-7d1f49bed2d0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = mHIBytCb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 06:39:47 user nova-compute[71711]: node.name = iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31
Apr 12 06:39:47 user nova-compute[71711]: node.tpgt = -1
Apr 12 06:39:47 user nova-compute[71711]: node.startup = automatic
Apr 12 06:39:47 user nova-compute[71711]: node.leading_login = No
Apr 12 06:39:47 user nova-compute[71711]: iface.iscsi_ifacename = default
Apr 12 06:39:47 user nova-compute[71711]: iface.net_ifacename = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.ipaddress = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.prefix_len = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.hwaddress = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.transport_name = tcp
Apr 12 06:39:47 user nova-compute[71711]: iface.initiatorname = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.state = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.vlan_id = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.vlan_priority = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.vlan_state = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.iface_num = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.mtu = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.port = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.bootproto = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.subnet_mask = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.gateway = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.dhcp_alt_client_id = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.dhcp_dns = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.dhcp_learn_iqn = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.dhcp_vendor_id_state = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.dhcp_vendor_id = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.dhcp_slp_da = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.fragmentation = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.gratuitous_arp = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.incoming_forwarding = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.tos_state = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.tos = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.ttl = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.delayed_ack = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.tcp_nagle = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.tcp_wsf_state = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.tcp_wsf = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.tcp_timer_scale = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.tcp_timestamp = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.redirect = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.def_task_mgmt_timeout = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.header_digest = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.data_digest = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.immediate_data = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.initial_r2t = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.data_seq_inorder = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.data_pdu_inorder = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.erl = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.max_receive_data_len = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.first_burst_len = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.max_outstanding_r2t = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.max_burst_len = 0
Apr 12 06:39:47 user nova-compute[71711]: iface.chap_auth = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.bidi_chap = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.strict_login_compliance = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.discovery_auth = <empty>
Apr 12 06:39:47 user nova-compute[71711]: iface.discovery_logout = <empty>
Apr 12 06:39:47 user nova-compute[71711]: node.discovery_address = <empty>
Apr 12 06:39:47 user nova-compute[71711]: node.discovery_port = 0
Apr 12 06:39:47 user nova-compute[71711]: node.discovery_type = static
Apr 12 06:39:47 user nova-compute[71711]: node.session.initial_cmdsn = 0
Apr 12 06:39:47 user nova-compute[71711]: node.session.initial_login_retry_max = 8
Apr 12 06:39:47 user nova-compute[71711]: node.session.xmit_thread_priority = -20
Apr 12 06:39:47 user nova-compute[71711]: node.session.cmds_max = 128
Apr 12 06:39:47 user nova-compute[71711]: node.session.queue_depth = 32
Apr 12 06:39:47 user nova-compute[71711]: node.session.nr_sessions = 1
Apr 12 06:39:47 user nova-compute[71711]: node.session.auth.authmethod = CHAP
Apr 12 06:39:47 user nova-compute[71711]: node.session.auth.username = mHIBytCb
Apr 12 06:39:47 user nova-compute[71711]: node.session.auth.password = ***
Apr 12 06:39:47 user nova-compute[71711]: node.session.auth.username_in = <empty>
Apr 12 06:39:47 user nova-compute[71711]: node.session.auth.password_in = <empty>
Apr 12 06:39:47 user nova-compute[71711]: node.session.auth.chap_algs = MD5
Apr 12 06:39:47 user nova-compute[71711]: node.session.timeo.replacement_timeout = 120
Apr 12 06:39:47 user nova-compute[71711]: node.session.err_timeo.abort_timeout = 15
Apr 12 06:39:47 user nova-compute[71711]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 06:39:47 user nova-compute[71711]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 06:39:47 user nova-compute[71711]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 06:39:47 user nova-compute[71711]: node.session.iscsi.FastAbort = Yes
Apr 12 06:39:47 user nova-compute[71711]: node.session.iscsi.InitialR2T = No
Apr 12 06:39:47 user nova-compute[71711]: node.session.iscsi.ImmediateData = Yes
Apr 12 06:39:47 user nova-compute[71711]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 06:39:47 user nova-compute[71711]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 06:39:47 user nova-compute[71711]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 06:39:47 user nova-compute[71711]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 06:39:47 user nova-compute[71711]: node.session.iscsi.MaxConnections = 1
Apr 12 06:39:47 user nova-compute[71711]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 06:39:47 user nova-compute[71711]: node.session.iscsi.ERL = 0
Apr 12 06:39:47 user nova-compute[71711]: node.session.scan = manual
Apr 12 06:39:47 user nova-compute[71711]: node.session.reopen_max = 0
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].address = 172.16.0.220
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].port = 3260
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].startup = manual
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].tcp.window_size = 524288
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].tcp.type_of_service = 0
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].timeo.logout_timeout = 15
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].timeo.login_timeout = 15
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].timeo.auth_timeout = 45
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].iscsi.DataDigest = None
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].iscsi.IFMarker = No
Apr 12 06:39:47 user nova-compute[71711]: node.conn[0].iscsi.OFMarker = No
Apr 12 06:39:47 user nova-compute[71711]: # END RECORD
Apr 12 06:39:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0894afc1-b3f0-4387-91d4-35506f549f24]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fff8132-66b0-4ba8-b326-4261b1d61e1e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHIBytCb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHIBytCb" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d23f6d-8108-44fa-a098-9d8e221db754]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHIBytCb'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c87633-a84a-4ea2-ab50-7746f1b07446]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dba892-c893-4cf8-a636-8c005bb458b7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:39:47 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:39:47 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:39:47 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:39:47 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:39:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:39:47 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:39:47 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:39:47 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:39:47 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:39:47 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.159s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] HCTL ('35', '0', '0', 0) found on session 37 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefe189d-cc86-40f4-a55b-ae945240ffa4]: (4, ('0 0 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Searching for a device in session 37 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHIBytCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23439363936323037', 'path': '/dev/sdd'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439363936323037', 'path': '/dev/sdd'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1451717232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1451717232',id=32,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:38:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-d5n9p9t2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:38:09Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=207359ea-0c81-46aa-a638-276957be0112,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "vif_mac": "fa:16:3e:75:b7:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "vif_mac": "fa:16:3e:75:b7:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:b7:30,bridge_name='br-int',has_traffic_filtering=True,id=b9933569-0e24-4acb-b85d-ccb1eb9c5721,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9933569-0e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG nova.objects.instance [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'pci_devices' on Instance uuid 207359ea-0c81-46aa-a638-276957be0112 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:39:47 user nova-compute[71711]:   <uuid>207359ea-0c81-46aa-a638-276957be0112</uuid>
Apr 12 06:39:47 user nova-compute[71711]:   <name>instance-00000020</name>
Apr 12 06:39:47 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:39:47 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:39:47 user nova-compute[71711]:   <metadata>
Apr 12 06:39:47 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:39:47 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:39:47 user nova-compute[71711]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1451717232</nova:name>
Apr 12 06:39:47 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:39:46</nova:creationTime>
Apr 12 06:39:47 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:39:47 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:39:47 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:39:47 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:39:47 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:39:47 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:39:47 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:39:47 user nova-compute[71711]:       <nova:owner>
Apr 12 06:39:47 user nova-compute[71711]:         <nova:user uuid="2e5e4455358643b8830ce8c96aad5aad">tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member</nova:user>
Apr 12 06:39:47 user nova-compute[71711]:         <nova:project uuid="0ecae91e53ee4d70a8dc24c7febc2a0e">tempest-ServerBootFromVolumeStableRescueTest-2063268056</nova:project>
Apr 12 06:39:47 user nova-compute[71711]:       </nova:owner>
Apr 12 06:39:47 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:39:47 user nova-compute[71711]:       <nova:ports>
Apr 12 06:39:47 user nova-compute[71711]:         <nova:port uuid="b9933569-0e24-4acb-b85d-ccb1eb9c5721">
Apr 12 06:39:47 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 06:39:47 user nova-compute[71711]:         </nova:port>
Apr 12 06:39:47 user nova-compute[71711]:       </nova:ports>
Apr 12 06:39:47 user nova-compute[71711]:     </nova:instance>
Apr 12 06:39:47 user nova-compute[71711]:   </metadata>
Apr 12 06:39:47 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:39:47 user nova-compute[71711]:     <system>
Apr 12 06:39:47 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:39:47 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:39:47 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:39:47 user nova-compute[71711]:       <entry name="serial">207359ea-0c81-46aa-a638-276957be0112</entry>
Apr 12 06:39:47 user nova-compute[71711]:       <entry name="uuid">207359ea-0c81-46aa-a638-276957be0112</entry>
Apr 12 06:39:47 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:39:47 user nova-compute[71711]:     </system>
Apr 12 06:39:47 user nova-compute[71711]:   </sysinfo>
Apr 12 06:39:47 user nova-compute[71711]:   <os>
Apr 12 06:39:47 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:39:47 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:39:47 user nova-compute[71711]:   </os>
Apr 12 06:39:47 user nova-compute[71711]:   <features>
Apr 12 06:39:47 user nova-compute[71711]:     <acpi/>
Apr 12 06:39:47 user nova-compute[71711]:     <apic/>
Apr 12 06:39:47 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:39:47 user nova-compute[71711]:   </features>
Apr 12 06:39:47 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:39:47 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:39:47 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:39:47 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:39:47 user nova-compute[71711]:   </clock>
Apr 12 06:39:47 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:39:47 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:39:47 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:39:47 user nova-compute[71711]:   </cpu>
Apr 12 06:39:47 user nova-compute[71711]:   <devices>
Apr 12 06:39:47 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:39:47 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:39:47 user nova-compute[71711]:       <source dev="/dev/sdd"/>
Apr 12 06:39:47 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:39:47 user nova-compute[71711]:       <serial>3b12a713-8214-4892-a05d-c4ae96583b31</serial>
Apr 12 06:39:47 user nova-compute[71711]:     </disk>
Apr 12 06:39:47 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:39:47 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:39:47 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.rescue"/>
Apr 12 06:39:47 user nova-compute[71711]:       <target dev="vdb" bus="virtio"/>
Apr 12 06:39:47 user nova-compute[71711]:       <boot order="1"/>
Apr 12 06:39:47 user nova-compute[71711]:     </disk>
Apr 12 06:39:47 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:39:47 user nova-compute[71711]:       <mac address="fa:16:3e:75:b7:30"/>
Apr 12 06:39:47 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:39:47 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:39:47 user nova-compute[71711]:       <target dev="tapb9933569-0e"/>
Apr 12 06:39:47 user nova-compute[71711]:     </interface>
Apr 12 06:39:47 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:39:47 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/console.log" append="off"/>
Apr 12 06:39:47 user nova-compute[71711]:     </serial>
Apr 12 06:39:47 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:39:47 user nova-compute[71711]:     <video>
Apr 12 06:39:47 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:39:47 user nova-compute[71711]:     </video>
Apr 12 06:39:47 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:39:47 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:39:47 user nova-compute[71711]:     </rng>
Apr 12 06:39:47 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:39:47 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:39:47 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:39:47 user nova-compute[71711]:     </memballoon>
Apr 12 06:39:47 user nova-compute[71711]:   </devices>
Apr 12 06:39:47 user nova-compute[71711]: </domain>
Apr 12 06:39:47 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:39:47 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 207359ea-0c81-46aa-a638-276957be0112] Instance destroyed successfully.
Apr 12 06:39:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] No VIF found with MAC fa:16:3e:75:b7:30, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:39:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:48 user nova-compute[71711]: DEBUG nova.compute.manager [req-12dc2c76-7b68-4f7e-9b48-7eab10ce665e req-201aaded-f372-4fa4-b40a-dcfa24e8f37b service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:39:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-12dc2c76-7b68-4f7e-9b48-7eab10ce665e req-201aaded-f372-4fa4-b40a-dcfa24e8f37b service nova] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-12dc2c76-7b68-4f7e-9b48-7eab10ce665e req-201aaded-f372-4fa4-b40a-dcfa24e8f37b service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-12dc2c76-7b68-4f7e-9b48-7eab10ce665e req-201aaded-f372-4fa4-b40a-dcfa24e8f37b service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:48 user nova-compute[71711]: DEBUG nova.compute.manager [req-12dc2c76-7b68-4f7e-9b48-7eab10ce665e req-201aaded-f372-4fa4-b40a-dcfa24e8f37b service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] No waiting events found dispatching network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:39:48 user nova-compute[71711]: WARNING nova.compute.manager [req-12dc2c76-7b68-4f7e-9b48-7eab10ce665e req-201aaded-f372-4fa4-b40a-dcfa24e8f37b service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received unexpected event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance with vm_state active and task_state rescuing.
Apr 12 06:39:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmGatSdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:39:50 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:39:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:39:50 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:39:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:39:50 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f51848-883a-47b4-baa3-e96ffef249e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:39:50 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a62026-cd14-4743-8c75-307cfb9a993a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5] added
Apr 12 06:39:50 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for 207359ea-0c81-46aa-a638-276957be0112 due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281590.7783067, 207359ea-0c81-46aa-a638-276957be0112 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:39:50 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] VM Resumed (Lifecycle Event)
Apr 12 06:39:50 user nova-compute[71711]: DEBUG nova.compute.manager [None req-9e2f24d6-4048-46e5-ae11-4b48d179bd04 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a61c3d3-df66-4727-8d8b-ab60ef0eaf57]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e44315-a483-4920-93ee-3eb0fc38aa76]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG nova.compute.manager [req-78c4450a-872c-4931-b84b-87f3b4fa11fa req-bc34e775-9ee4-4e76-a16e-aeb3347c699b service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-78c4450a-872c-4931-b84b-87f3b4fa11fa req-bc34e775-9ee4-4e76-a16e-aeb3347c699b service nova] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-78c4450a-872c-4931-b84b-87f3b4fa11fa req-bc34e775-9ee4-4e76-a16e-aeb3347c699b service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-78c4450a-872c-4931-b84b-87f3b4fa11fa req-bc34e775-9ee4-4e76-a16e-aeb3347c699b service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG nova.compute.manager [req-78c4450a-872c-4931-b84b-87f3b4fa11fa req-bc34e775-9ee4-4e76-a16e-aeb3347c699b service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] No waiting events found dispatching network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:39:50 user nova-compute[71711]: WARNING nova.compute.manager [req-78c4450a-872c-4931-b84b-87f3b4fa11fa req-bc34e775-9ee4-4e76-a16e-aeb3347c699b service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received unexpected event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance with vm_state active and task_state rescuing.
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YmGatSdx {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:50 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 06:39:50 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281590.7794352, 207359ea-0c81-46aa-a638-276957be0112 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:39:50 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] VM Started (Lifecycle Event)
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YmGatSdx" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea947b41-9081-48e2-a282-f8d582ac5b62]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YmGatSdx'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ccfbb0-76c4-4ddd-b58f-869356ef6003]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[199cc672-f98c-4d5c-8962-f532b2c3ad56]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:39:50 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:39:50 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:39:50 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:39:50 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:39:50 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:39:50 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:39:50 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:39:50 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:39:50 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:39:50 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:39:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99ecff9-5a17-40f2-bdcf-2d672670c0f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5, portal: 172.16.0.220,3260]
Apr 12 06:39:51 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5, portal: 172.16.0.220,3260] successful.
Apr 12 06:39:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[666fe361-f4a4-466d-ad1d-09328ba0df33]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7ced94-0719-4e6a-99d2-cc4d815b8b7c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:39:51 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:39:51 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:39:51 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:39:51 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:39:51 user nova-compute[71711]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 (non-flash)
Apr 12 06:39:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:39:51 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:39:51 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:39:51 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:39:51 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:39:51 user nova-compute[71711]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 (non-flash)
Apr 12 06:39:51 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b83e7b-877e-4bdc-9d7a-bdc66a364948]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:39:51 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmGatSdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:39:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:39:52 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23835366439343366', 'path': '/dev/sdg'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:39:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835366439343366', 'path': '/dev/sdg'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:39:52 user nova-compute[71711]: DEBUG nova.objects.instance [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'flavor' on Instance uuid f93121be-8fbc-4b92-856a-64bf9f192532 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:39:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:39:52 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:39:52 user nova-compute[71711]:   <source dev="/dev/sdg"/>
Apr 12 06:39:52 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:39:52 user nova-compute[71711]:   <serial>a7204ed1-e658-42f0-b1fd-590e8b56f1f5</serial>
Apr 12 06:39:52 user nova-compute[71711]: </disk>
Apr 12 06:39:52 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:39:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:39:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:39:52 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No VIF found with MAC fa:16:3e:5e:e5:aa, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:39:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2dc40915-d342-4e6f-ae82-0367b5064218 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "f93121be-8fbc-4b92-856a-64bf9f192532" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.670s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:39:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:39:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "f93121be-8fbc-4b92-856a-64bf9f192532" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "f93121be-8fbc-4b92-856a-64bf9f192532" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:53 user nova-compute[71711]: INFO nova.compute.manager [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Detaching volume a7204ed1-e658-42f0-b1fd-590e8b56f1f5
Apr 12 06:39:53 user nova-compute[71711]: INFO nova.virt.block_device [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Attempting to driver detach volume a7204ed1-e658-42f0-b1fd-590e8b56f1f5 from mountpoint /dev/vdb
Apr 12 06:39:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Attempting to detach device vdb from instance f93121be-8fbc-4b92-856a-64bf9f192532 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:39:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:39:53 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:39:53 user nova-compute[71711]:   <source dev="/dev/sdg"/>
Apr 12 06:39:53 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:39:53 user nova-compute[71711]:   <serial>a7204ed1-e658-42f0-b1fd-590e8b56f1f5</serial>
Apr 12 06:39:53 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:39:53 user nova-compute[71711]: </disk>
Apr 12 06:39:53 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:39:54 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully detached device vdb from instance f93121be-8fbc-4b92-856a-64bf9f192532 from the persistent domain config.
Apr 12 06:39:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f93121be-8fbc-4b92-856a-64bf9f192532 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:39:54 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:39:54 user nova-compute[71711]:   <source dev="/dev/sdg"/>
Apr 12 06:39:54 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:39:54 user nova-compute[71711]:   <serial>a7204ed1-e658-42f0-b1fd-590e8b56f1f5</serial>
Apr 12 06:39:54 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:39:54 user nova-compute[71711]: </disk>
Apr 12 06:39:54 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681281594.4487734, f93121be-8fbc-4b92-856a-64bf9f192532 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f93121be-8fbc-4b92-856a-64bf9f192532 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:39:54 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully detached device vdb from instance f93121be-8fbc-4b92-856a-64bf9f192532 from the live domain config.
Apr 12 06:39:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YmGatSdx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:39:54 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b808a3e2-4f82-4565-a686-e8cea661277f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:39:54 user nova-compute[71711]: No targets found.
Apr 12 06:39:54 user nova-compute[71711]: iSNS:
Apr 12 06:39:54 user nova-compute[71711]: No targets found.
Apr 12 06:39:54 user nova-compute[71711]: STATIC:
Apr 12 06:39:54 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7
Apr 12 06:39:54 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:39:54 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:39:54 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a
Apr 12 06:39:54 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:39:54 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:39:54 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5
Apr 12 06:39:54 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:39:54 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:39:54 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31
Apr 12 06:39:54 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:39:54 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:39:54 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf
Apr 12 06:39:54 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:39:54 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:39:54 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:39:54 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:39:54 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:39:54 user nova-compute[71711]: FIRMWARE:
Apr 12 06:39:54 user nova-compute[71711]: No targets found.
Apr 12 06:39:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:39:54 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:39:54 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f43934-d3d6-4467-ab83-9b85d4ca4f59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bf9862-55fd-4f0d-8e7a-e41126fffa4b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:39:54 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:39:54 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:39:54 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:39:54 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:39:54 user nova-compute[71711]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 (non-flash)
Apr 12 06:39:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:39:54 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:39:54 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:39:54 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:39:54 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:39:54 user nova-compute[71711]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 (non-flash)
Apr 12 06:39:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c204c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5'): ({'sdg'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Removing single pathed devices sdg {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[198e9537-a965-449d-954a-b9646f7c4b0c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[266f0baa-72a0-4356-bfe6-a7f470c5b637]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flushing IO for device /dev/sdg {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4cee96-07e0-4c60-9c46-83f5a2804718]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e719cb-a222-4a5d-837d-83b067c035f2]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] SCSI volumes sdg have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6be1a70-612d-49ed-bd4f-0301597326a2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[46116f30-386e-4205-89c1-af5e8f825985]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5, portal: 172.16.0.220,3260]
Apr 12 06:39:54 user nova-compute[71711]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5, portal: 172.16.0.220,3260] successful.
Apr 12 06:39:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7204ed1-e658-42f0-b1fd-590e8b56f1f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[15204ddf-6b4f-4a25-a282-7af9c8dbcce7]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] <== disconnect_volume: return (338ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:39:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'flavor' on Instance uuid f93121be-8fbc-4b92-856a-64bf9f192532 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c84aea56-b77a-434a-92e7-56d0e0d8e0a8 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "f93121be-8fbc-4b92-856a-64bf9f192532" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.740s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:55 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:56 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:39:58 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:39:58 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7919MB free_disk=25.930007934570312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance faa2ad52-9528-4013-ad20-4a1d636aed14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance f93121be-8fbc-4b92-856a-64bf9f192532 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 207359ea-0c81-46aa-a638-276957be0112 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:39:58 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:39:59 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:39:59 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:39:59 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:39:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:39:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:40:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:40:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:40:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:40:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:40:00 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:40:00 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Updating instance_info_cache with network_info: [{"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:40:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-c64aff93-15fa-4520-b6ac-cdcacb49478e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:40:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:40:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:40:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:40:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:40:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Received event network-changed-744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:01 user nova-compute[71711]: DEBUG nova.compute.manager [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Refreshing instance network info cache due to event network-changed-744814ae-b032-41e5-b122-8d5ff605d349. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:40:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] Acquiring lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:40:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] Acquired lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:40:01 user nova-compute[71711]: DEBUG nova.network.neutron [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Refreshing network info cache for port 744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:40:02 user nova-compute[71711]: DEBUG nova.network.neutron [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Updated VIF entry in instance network info cache for port 744814ae-b032-41e5-b122-8d5ff605d349. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:40:02 user nova-compute[71711]: DEBUG nova.network.neutron [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Updating instance_info_cache with network_info: [{"id": "744814ae-b032-41e5-b122-8d5ff605d349", "address": "fa:16:3e:c2:8c:71", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744814ae-b0", "ovs_interfaceid": "744814ae-b032-41e5-b122-8d5ff605d349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:40:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9283419e-9e5c-4d9e-ad94-4c7d293cd8a2 req-8743baf5-d9a2-4a9d-82e4-1173793fabcc service nova] Releasing lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:40:02 user nova-compute[71711]: DEBUG nova.compute.manager [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Stashing vm_state: active {{(pid=71711) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 06:40:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:02 user nova-compute[71711]: DEBUG nova.objects.instance [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'pci_requests' on Instance uuid 51402ffe-ef35-41a3-811b-5a00788a13d8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:40:02 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:40:02 user nova-compute[71711]: INFO nova.compute.claims [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Claim successful on node user
Apr 12 06:40:02 user nova-compute[71711]: DEBUG nova.objects.instance [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'resources' on Instance uuid 51402ffe-ef35-41a3-811b-5a00788a13d8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:40:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:02 user nova-compute[71711]: DEBUG nova.objects.instance [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'pci_devices' on Instance uuid 51402ffe-ef35-41a3-811b-5a00788a13d8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:40:02 user nova-compute[71711]: INFO nova.compute.resource_tracker [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Updating resource usage from migration b110bd15-f7b1-42c7-8ad7-36836b8cdaf5
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:03 user nova-compute[71711]: INFO nova.compute.manager [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Detaching volume ff76495e-eafb-4932-9636-e017f0a60dbf
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.507s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:03 user nova-compute[71711]: INFO nova.compute.manager [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Migrating
Apr 12 06:40:03 user nova-compute[71711]: INFO nova.virt.block_device [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Attempting to driver detach volume ff76495e-eafb-4932-9636-e017f0a60dbf from mountpoint /dev/vdb
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquired lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.network.neutron [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Attempting to detach device vdb from instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:40:03 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:40:03 user nova-compute[71711]:   <source dev="/dev/sdc"/>
Apr 12 06:40:03 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:40:03 user nova-compute[71711]:   <serial>ff76495e-eafb-4932-9636-e017f0a60dbf</serial>
Apr 12 06:40:03 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:40:03 user nova-compute[71711]: </disk>
Apr 12 06:40:03 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:40:03 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Successfully detached device vdb from instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 from the persistent domain config.
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:40:03 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:40:03 user nova-compute[71711]:   <source dev="/dev/sdc"/>
Apr 12 06:40:03 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:40:03 user nova-compute[71711]:   <serial>ff76495e-eafb-4932-9636-e017f0a60dbf</serial>
Apr 12 06:40:03 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:40:03 user nova-compute[71711]: </disk>
Apr 12 06:40:03 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.compute.manager [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received event network-changed-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.compute.manager [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Refreshing instance network info cache due to event network-changed-764f8775-3274-4813-97b0-4514b81b7c2e. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] Acquiring lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.network.neutron [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Updating instance_info_cache with network_info: [{"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681281603.6673508, 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:40:03 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Successfully detached device vdb from instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 from the live domain config.
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Releasing lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] Acquired lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.network.neutron [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Refreshing network info cache for port 764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBTgevpr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:40:03 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f3e325-eaea-40e5-8f9f-ccb78303e402]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:40:03 user nova-compute[71711]: No targets found.
Apr 12 06:40:03 user nova-compute[71711]: iSNS:
Apr 12 06:40:03 user nova-compute[71711]: No targets found.
Apr 12 06:40:03 user nova-compute[71711]: STATIC:
Apr 12 06:40:03 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7
Apr 12 06:40:03 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:40:03 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:40:03 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a
Apr 12 06:40:03 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:40:03 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:40:03 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31
Apr 12 06:40:03 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:40:03 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:40:03 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf
Apr 12 06:40:03 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:40:03 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:40:03 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:40:03 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:40:03 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:40:03 user nova-compute[71711]: FIRMWARE:
Apr 12 06:40:03 user nova-compute[71711]: No targets found.
Apr 12 06:40:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:40:03 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:40:03 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b3a69e-27fa-44f1-86fa-1cf8a4d6dd30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Starting migrate_disk_and_power_off {{(pid=71711) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4defa21f-c023-40b3-a0be-1048365c1389]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:40:03 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:40:03 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:40:03 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:40:03 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:40:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:40:03 user nova-compute[71711]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf (non-flash)
Apr 12 06:40:03 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:40:03 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:40:03 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:40:03 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9954361f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf'): ({'sdc'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Removing single pathed devices sdc {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d819daa2-b37f-4fba-97bc-181d34e1ce7d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c4340a-00a4-4002-9f6d-22422824761b]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Flushing IO for device /dev/sdc {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[498f70f1-81ae-4614-9183-858577d7f11d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d936e4-fdd9-4a14-91ae-b92a7422861c]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:40:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.130s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[56462cf3-3ba1-4687-a92b-867da772328b]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce2f648-3451-4b3e-a8a3-290436e9b603]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf, portal: 172.16.0.220,3260]
Apr 12 06:40:04 user nova-compute[71711]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf, portal: 172.16.0.220,3260] successful.
Apr 12 06:40:04 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff76495e-eafb-4932-9636-e017f0a60dbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d65a8fb-fe31-4189-826e-1a87a813749f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.504s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] <== disconnect_volume: return (506ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG nova.network.neutron [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Updated VIF entry in instance network info cache for port 764f8775-3274-4813-97b0-4514b81b7c2e. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG nova.network.neutron [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Updating instance_info_cache with network_info: [{"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-89756e25-0ad8-4a5f-ae9e-97949730d7c3 req-ebfefec0-9403-4ad1-a097-d24d0925e666 service nova] Releasing lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:04 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Instance destroyed successfully.
Apr 12 06:40:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:38:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2019289684',display_name='tempest-ServerActionsTestJSON-server-2019289684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2019289684',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:38:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-6qrxgbgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=51402ffe-ef35-41a3-811b-5a00788a13d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7b:ab:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7b:ab:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_vif [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap764f8775-32, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:40:04 user nova-compute[71711]: INFO os_vif [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32')
Apr 12 06:40:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIEsORw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:40:04 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[006da50c-3242-41f3-8154-f199aa6615b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:40:04 user nova-compute[71711]: No targets found.
Apr 12 06:40:04 user nova-compute[71711]: iSNS:
Apr 12 06:40:04 user nova-compute[71711]: No targets found.
Apr 12 06:40:04 user nova-compute[71711]: STATIC:
Apr 12 06:40:04 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7
Apr 12 06:40:04 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:40:04 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:40:04 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a
Apr 12 06:40:04 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:40:04 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:40:04 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31
Apr 12 06:40:04 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:40:04 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:40:04 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:40:04 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:40:04 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:40:04 user nova-compute[71711]: FIRMWARE:
Apr 12 06:40:04 user nova-compute[71711]: No targets found.
Apr 12 06:40:04 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:40:04 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:40:04 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe2e13-7bb3-4774-8c96-e320aabeb12f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff0403c-37e8-4240-ad6a-438236821e7e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:40:04 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:40:04 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:40:04 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:40:04 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:40:04 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:40:04 user nova-compute[71711]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:40:04 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:40:04 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9954331fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7'): ({'sde'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Removing single pathed devices sde {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce755a2-0613-48a0-b15f-be7158e90f33]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c78a84f-ff0a-4ae6-ab80-7b6f601729bc]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flushing IO for device /dev/sde {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed90122-06b8-49fe-9831-960bcd5ee9c0]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bdcc50-5d29-43a6-94b5-72f2d945da95]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] SCSI volumes sde have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23861643530663738', '/dev/disk/by-id/scsi-1SCST_BIO47a70ac2-8ad50f7874045927', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_47a70ac2') {{(pid=81777) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[727acb3d-2b97-4f0d-b87c-bb8f5789b796]: (4, None) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e728cd3-ee15-45f8-bfb7-82129f9b5665]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e389c27-acab-4cf3-be1d-34a01d863b19]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260]
Apr 12 06:40:04 user nova-compute[71711]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260] successful.
Apr 12 06:40:04 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb34cf6-78c6-4d66-a9a4-c19476af3e76]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== disconnect_volume: return (316ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:40:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG nova.objects.instance [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'flavor' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-34433dcd-3d86-40a8-a390-6820efa83271 tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.960s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received event network-vif-unplugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] No waiting events found dispatching network-vif-unplugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:40:05 user nova-compute[71711]: WARNING nova.compute.manager [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received unexpected event network-vif-unplugged-764f8775-3274-4813-97b0-4514b81b7c2e for instance with vm_state active and task_state resize_migrating.
Apr 12 06:40:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received event network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] No waiting events found dispatching network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:40:05 user nova-compute[71711]: WARNING nova.compute.manager [req-fc030e5f-5ff1-43db-8750-d87c5e2aabf4 req-eedfe0d1-6cfb-4df3-8a9b-3106e5b2c371 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received unexpected event network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e for instance with vm_state active and task_state resize_migrating.
Apr 12 06:40:05 user nova-compute[71711]: DEBUG nova.network.neutron [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Port 764f8775-3274-4813-97b0-4514b81b7c2e binding to destination host user is already ACTIVE {{(pid=71711) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquired lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG nova.network.neutron [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG nova.network.neutron [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Updating instance_info_cache with network_info: [{"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Releasing lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG os_brick.utils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47e1cae-3a39-4844-b4d1-68598022d26e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b4ff6b-d0bb-420a-afd8-ebbe5222bfe4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f01b5a-f6be-4319-8955-f190624a67e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db127a6-02f8-45ea-a41a-08edbb5f36db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:40:06 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:40:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1dbf29-a8e1-47ef-93f0-29826877ac63]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:40:06 user nova-compute[71711]: DEBUG os_brick.utils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:40:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Starting finish_migration {{(pid=71711) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Instance directory exists: not creating {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 06:40:10 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Creating image(s)
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Ensure instance console log exists: /opt/stack/data/nova/instances/51402ffe-ef35-41a3-811b-5a00788a13d8/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Start _get_guest_xml network_info=[{"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7b:ab:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIEsORw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '51402ffe-ef35-41a3-811b-5a00788a13d8', 'attached_at': '2023-04-12T06:40:11.000000', 'detached_at': '', 'volume_id': '6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'serial': '6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7'}, 'attachment_id': '5f20b09a-1757-4c0c-a2f8-9cac857e264c', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:40:10 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:40:10 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.objects.instance [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'vcpu_model' on Instance uuid 51402ffe-ef35-41a3-811b-5a00788a13d8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIEsORw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:40:10 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:40:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:40:10 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:40:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:40:10 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:40:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbd5806-0727-46b5-959d-b4f36bc9df35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:40:10 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe6a6cf-b3e8-4007-bb93-76b1cb081c4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7] added
Apr 12 06:40:10 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0801ff41-568c-47a4-bc4b-1a074cf2dc32]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad4b0c8-b416-4057-84c5-d5cafa1d66fb]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMIEsORw {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMIEsORw" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1700cb-9861-40b7-b373-0dda103abc96]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jMIEsORw'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1f36d1-cc24-4878-82d2-680cf1e5dc4d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e2183f-2f6c-4b3e-b73f-1fd78b18ddc5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:40:11 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:40:11 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:40:11 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:40:11 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:40:11 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:40:11 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f05bdd9-ed7e-494d-ad48-a0a1e9c1e6a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260]
Apr 12 06:40:11 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260] successful.
Apr 12 06:40:11 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b9fba7-5855-4dc6-ad28-06fd07a96370]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec55761-288c-4134-9d8f-8547aba03553]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:40:11 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:40:11 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:40:11 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:40:11 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:40:11 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:40:11 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:40:11 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:40:11 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[484e18fc-4338-42e8-b757-c806944f8d91]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:40:11 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIEsORw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23861643530663738', 'path': '/dev/sdc'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861643530663738', 'path': '/dev/sdc'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:38:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2019289684',display_name='tempest-ServerActionsTestJSON-server-2019289684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2019289684',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:38:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-6qrxgbgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:40:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=51402ffe-ef35-41a3-811b-5a00788a13d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7b:ab:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7b:ab:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:40:12 user nova-compute[71711]:   <uuid>51402ffe-ef35-41a3-811b-5a00788a13d8</uuid>
Apr 12 06:40:12 user nova-compute[71711]:   <name>instance-00000021</name>
Apr 12 06:40:12 user nova-compute[71711]:   <memory>196608</memory>
Apr 12 06:40:12 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:40:12 user nova-compute[71711]:   <metadata>
Apr 12 06:40:12 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:40:12 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:40:12 user nova-compute[71711]:       <nova:name>tempest-ServerActionsTestJSON-server-2019289684</nova:name>
Apr 12 06:40:12 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:40:10</nova:creationTime>
Apr 12 06:40:12 user nova-compute[71711]:       <nova:flavor name="m1.micro">
Apr 12 06:40:12 user nova-compute[71711]:         <nova:memory>192</nova:memory>
Apr 12 06:40:12 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:40:12 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:40:12 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:40:12 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:40:12 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:40:12 user nova-compute[71711]:       <nova:owner>
Apr 12 06:40:12 user nova-compute[71711]:         <nova:user uuid="ad316acdc89947bbba60c75e9a24d7e9">tempest-ServerActionsTestJSON-752347644-project-member</nova:user>
Apr 12 06:40:12 user nova-compute[71711]:         <nova:project uuid="54fd87c4105246c1ac1bdf424c83b7aa">tempest-ServerActionsTestJSON-752347644</nova:project>
Apr 12 06:40:12 user nova-compute[71711]:       </nova:owner>
Apr 12 06:40:12 user nova-compute[71711]:       <nova:ports>
Apr 12 06:40:12 user nova-compute[71711]:         <nova:port uuid="764f8775-3274-4813-97b0-4514b81b7c2e">
Apr 12 06:40:12 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:40:12 user nova-compute[71711]:         </nova:port>
Apr 12 06:40:12 user nova-compute[71711]:       </nova:ports>
Apr 12 06:40:12 user nova-compute[71711]:     </nova:instance>
Apr 12 06:40:12 user nova-compute[71711]:   </metadata>
Apr 12 06:40:12 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:40:12 user nova-compute[71711]:     <system>
Apr 12 06:40:12 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:40:12 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:40:12 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:40:12 user nova-compute[71711]:       <entry name="serial">51402ffe-ef35-41a3-811b-5a00788a13d8</entry>
Apr 12 06:40:12 user nova-compute[71711]:       <entry name="uuid">51402ffe-ef35-41a3-811b-5a00788a13d8</entry>
Apr 12 06:40:12 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:40:12 user nova-compute[71711]:     </system>
Apr 12 06:40:12 user nova-compute[71711]:   </sysinfo>
Apr 12 06:40:12 user nova-compute[71711]:   <os>
Apr 12 06:40:12 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:40:12 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:40:12 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:40:12 user nova-compute[71711]:   </os>
Apr 12 06:40:12 user nova-compute[71711]:   <features>
Apr 12 06:40:12 user nova-compute[71711]:     <acpi/>
Apr 12 06:40:12 user nova-compute[71711]:     <apic/>
Apr 12 06:40:12 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:40:12 user nova-compute[71711]:   </features>
Apr 12 06:40:12 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:40:12 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:40:12 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:40:12 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:40:12 user nova-compute[71711]:   </clock>
Apr 12 06:40:12 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:40:12 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:40:12 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:40:12 user nova-compute[71711]:   </cpu>
Apr 12 06:40:12 user nova-compute[71711]:   <devices>
Apr 12 06:40:12 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:40:12 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:40:12 user nova-compute[71711]:       <source dev="/dev/sdc"/>
Apr 12 06:40:12 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:40:12 user nova-compute[71711]:       <serial>6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7</serial>
Apr 12 06:40:12 user nova-compute[71711]:     </disk>
Apr 12 06:40:12 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:40:12 user nova-compute[71711]:       <mac address="fa:16:3e:7b:ab:03"/>
Apr 12 06:40:12 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:40:12 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:40:12 user nova-compute[71711]:       <target dev="tap764f8775-32"/>
Apr 12 06:40:12 user nova-compute[71711]:     </interface>
Apr 12 06:40:12 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:40:12 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/51402ffe-ef35-41a3-811b-5a00788a13d8/console.log" append="off"/>
Apr 12 06:40:12 user nova-compute[71711]:     </serial>
Apr 12 06:40:12 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:40:12 user nova-compute[71711]:     <video>
Apr 12 06:40:12 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:40:12 user nova-compute[71711]:     </video>
Apr 12 06:40:12 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:40:12 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:40:12 user nova-compute[71711]:     </rng>
Apr 12 06:40:12 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:40:12 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:40:12 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:40:12 user nova-compute[71711]:     </memballoon>
Apr 12 06:40:12 user nova-compute[71711]:   </devices>
Apr 12 06:40:12 user nova-compute[71711]: </domain>
Apr 12 06:40:12 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:38:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2019289684',display_name='tempest-ServerActionsTestJSON-server-2019289684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2019289684',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:38:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-6qrxgbgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:40:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=51402ffe-ef35-41a3-811b-5a00788a13d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7b:ab:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-566357441-network", "vif_mac": "fa:16:3e:7b:ab:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG os_vif [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap764f8775-32, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap764f8775-32, col_values=(('external_ids', {'iface-id': '764f8775-3274-4813-97b0-4514b81b7c2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:ab:03', 'vm-uuid': '51402ffe-ef35-41a3-811b-5a00788a13d8'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:12 user nova-compute[71711]: INFO os_vif [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32')
Apr 12 06:40:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:40:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] No VIF found with MAC fa:16:3e:7b:ab:03, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:40:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-00aec1c1-340d-44cf-8559-f0fe2a4f3b57 req-e005f245-c262-4cfe-86f5-31663eaad9b9 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received event network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-00aec1c1-340d-44cf-8559-f0fe2a4f3b57 req-e005f245-c262-4cfe-86f5-31663eaad9b9 service nova] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-00aec1c1-340d-44cf-8559-f0fe2a4f3b57 req-e005f245-c262-4cfe-86f5-31663eaad9b9 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-00aec1c1-340d-44cf-8559-f0fe2a4f3b57 req-e005f245-c262-4cfe-86f5-31663eaad9b9 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-00aec1c1-340d-44cf-8559-f0fe2a4f3b57 req-e005f245-c262-4cfe-86f5-31663eaad9b9 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] No waiting events found dispatching network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:40:13 user nova-compute[71711]: WARNING nova.compute.manager [req-00aec1c1-340d-44cf-8559-f0fe2a4f3b57 req-e005f245-c262-4cfe-86f5-31663eaad9b9 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received unexpected event network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e for instance with vm_state active and task_state resize_finish.
Apr 12 06:40:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for 51402ffe-ef35-41a3-811b-5a00788a13d8 due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:40:15 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281615.6776807, 51402ffe-ef35-41a3-811b-5a00788a13d8 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:40:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] VM Resumed (Lifecycle Event)
Apr 12 06:40:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:40:15 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Instance running successfully.
Apr 12 06:40:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Failed to set time: agent not configured {{(pid=71711) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 06:40:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-af442830-d2ed-48be-b437-d192d06f24ff tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] finish_migration finished successfully. {{(pid=71711) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 06:40:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:40:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:40:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 06:40:15 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281615.6792977, 51402ffe-ef35-41a3-811b-5a00788a13d8 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:40:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] VM Started (Lifecycle Event)
Apr 12 06:40:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:40:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:40:15 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 06:40:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-072b2eca-c10e-418b-8306-81323bf474ee req-0463df13-d691-41a8-ad35-0539d1693d39 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received event network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-072b2eca-c10e-418b-8306-81323bf474ee req-0463df13-d691-41a8-ad35-0539d1693d39 service nova] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-072b2eca-c10e-418b-8306-81323bf474ee req-0463df13-d691-41a8-ad35-0539d1693d39 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-072b2eca-c10e-418b-8306-81323bf474ee req-0463df13-d691-41a8-ad35-0539d1693d39 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-072b2eca-c10e-418b-8306-81323bf474ee req-0463df13-d691-41a8-ad35-0539d1693d39 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] No waiting events found dispatching network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:40:15 user nova-compute[71711]: WARNING nova.compute.manager [req-072b2eca-c10e-418b-8306-81323bf474ee req-0463df13-d691-41a8-ad35-0539d1693d39 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received unexpected event network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e for instance with vm_state resized and task_state None.
Apr 12 06:40:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:40:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:40:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:40:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:40:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:40:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "f93121be-8fbc-4b92-856a-64bf9f192532" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "f93121be-8fbc-4b92-856a-64bf9f192532" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:44 user nova-compute[71711]: INFO nova.compute.manager [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Terminating instance
Apr 12 06:40:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-6e57c31f-82ae-4cdf-b15a-68141ed93774 req-a4f7991c-9c19-416d-ba12-d52ee709ca85 service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Received event network-vif-unplugged-48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6e57c31f-82ae-4cdf-b15a-68141ed93774 req-a4f7991c-9c19-416d-ba12-d52ee709ca85 service nova] Acquiring lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6e57c31f-82ae-4cdf-b15a-68141ed93774 req-a4f7991c-9c19-416d-ba12-d52ee709ca85 service nova] Lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6e57c31f-82ae-4cdf-b15a-68141ed93774 req-a4f7991c-9c19-416d-ba12-d52ee709ca85 service nova] Lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-6e57c31f-82ae-4cdf-b15a-68141ed93774 req-a4f7991c-9c19-416d-ba12-d52ee709ca85 service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] No waiting events found dispatching network-vif-unplugged-48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-6e57c31f-82ae-4cdf-b15a-68141ed93774 req-a4f7991c-9c19-416d-ba12-d52ee709ca85 service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Received event network-vif-unplugged-48268378-1f2b-42d7-b20a-631f3de87f6b for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:40:44 user nova-compute[71711]: INFO nova.compute.manager [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Unrescuing
Apr 12 06:40:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquired lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG nova.network.neutron [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:40:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Instance destroyed successfully.
Apr 12 06:40:44 user nova-compute[71711]: DEBUG nova.objects.instance [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'resources' on Instance uuid f93121be-8fbc-4b92-856a-64bf9f192532 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-724406694',display_name='tempest-AttachVolumeNegativeTest-server-724406694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-724406694',id=31,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEW+augvNasE0Qo/REg3jlWWepgI/HiN9UN+M7OdB1zGToWMOZhc9DuX2ID5abQGOcG4pmVkcHOgGwHKchGMi30PiRS5OZhbYr1bILUuP6EjvFAI3iucPvSzavcZAk3qg==',key_name='tempest-keypair-15797926',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:38:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b267dce1303d451ca307eeaa38baf685',ramdisk_id='',reservation_id='r-lal9j3j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1905486920',owner_user_name='tempest-AttachVolumeNegativeTest-1905486920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:38:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',uuid=f93121be-8fbc-4b92-856a-64bf9f192532,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48268378-1f2b-42d7-b20a-631f3de87f6b", "address": "fa:16:3e:5e:e5:aa", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48268378-1f", "ovs_interfaceid": "48268378-1f2b-42d7-b20a-631f3de87f6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converting VIF {"id": "48268378-1f2b-42d7-b20a-631f3de87f6b", "address": "fa:16:3e:5e:e5:aa", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48268378-1f", "ovs_interfaceid": "48268378-1f2b-42d7-b20a-631f3de87f6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=48268378-1f2b-42d7-b20a-631f3de87f6b,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48268378-1f') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG os_vif [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=48268378-1f2b-42d7-b20a-631f3de87f6b,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48268378-1f') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48268378-1f, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:40:45 user nova-compute[71711]: INFO os_vif [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:e5:aa,bridge_name='br-int',has_traffic_filtering=True,id=48268378-1f2b-42d7-b20a-631f3de87f6b,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48268378-1f')
Apr 12 06:40:45 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Deleting instance files /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532_del
Apr 12 06:40:45 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Deletion of /opt/stack/data/nova/instances/f93121be-8fbc-4b92-856a-64bf9f192532_del complete
Apr 12 06:40:45 user nova-compute[71711]: INFO nova.compute.manager [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 12 06:40:45 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG nova.network.neutron [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Updating instance_info_cache with network_info: [{"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Releasing lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG nova.objects.instance [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'flavor' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG nova.compute.manager [req-95e3ad68-4222-49db-8a90-3ae32df3b95d req-4a166a8a-563f-4939-9580-1b225d833795 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-unplugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-95e3ad68-4222-49db-8a90-3ae32df3b95d req-4a166a8a-563f-4939-9580-1b225d833795 service nova] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-95e3ad68-4222-49db-8a90-3ae32df3b95d req-4a166a8a-563f-4939-9580-1b225d833795 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-95e3ad68-4222-49db-8a90-3ae32df3b95d req-4a166a8a-563f-4939-9580-1b225d833795 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:45 user nova-compute[71711]: DEBUG nova.compute.manager [req-95e3ad68-4222-49db-8a90-3ae32df3b95d req-4a166a8a-563f-4939-9580-1b225d833795 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] No waiting events found dispatching network-vif-unplugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:40:45 user nova-compute[71711]: WARNING nova.compute.manager [req-95e3ad68-4222-49db-8a90-3ae32df3b95d req-4a166a8a-563f-4939-9580-1b225d833795 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received unexpected event network-vif-unplugged-4d362992-cbb4-4530-b971-86688508274f for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:40:45 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Instance destroyed successfully.
Apr 12 06:40:46 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:40:46 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Took 1.11 seconds to deallocate network for instance.
Apr 12 06:40:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:46 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:40:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-994b12d8-5274-419f-aeb8-ac27c10727e8 req-7c3ea086-078c-4dfb-87cd-758743e5ff29 service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Received event network-vif-plugged-48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-994b12d8-5274-419f-aeb8-ac27c10727e8 req-7c3ea086-078c-4dfb-87cd-758743e5ff29 service nova] Acquiring lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-994b12d8-5274-419f-aeb8-ac27c10727e8 req-7c3ea086-078c-4dfb-87cd-758743e5ff29 service nova] Lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-994b12d8-5274-419f-aeb8-ac27c10727e8 req-7c3ea086-078c-4dfb-87cd-758743e5ff29 service nova] Lock "f93121be-8fbc-4b92-856a-64bf9f192532-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-994b12d8-5274-419f-aeb8-ac27c10727e8 req-7c3ea086-078c-4dfb-87cd-758743e5ff29 service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] No waiting events found dispatching network-vif-plugged-48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:40:46 user nova-compute[71711]: WARNING nova.compute.manager [req-994b12d8-5274-419f-aeb8-ac27c10727e8 req-7c3ea086-078c-4dfb-87cd-758743e5ff29 service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Received unexpected event network-vif-plugged-48268378-1f2b-42d7-b20a-631f3de87f6b for instance with vm_state deleted and task_state None.
Apr 12 06:40:46 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:40:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:46 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Deleted allocations for instance f93121be-8fbc-4b92-856a-64bf9f192532
Apr 12 06:40:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-570c21bb-9bcd-44b6-a360-1995098a0d5a tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "f93121be-8fbc-4b92-856a-64bf9f192532" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.535s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG nova.compute.manager [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG nova.compute.manager [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] No waiting events found dispatching network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:40:47 user nova-compute[71711]: WARNING nova.compute.manager [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received unexpected event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:40:47 user nova-compute[71711]: DEBUG nova.compute.manager [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Received event network-vif-deleted-48268378-1f2b-42d7-b20a-631f3de87f6b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG nova.compute.manager [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:47 user nova-compute[71711]: DEBUG nova.compute.manager [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] No waiting events found dispatching network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:40:47 user nova-compute[71711]: WARNING nova.compute.manager [req-1efc2a94-5470-4fe4-8d5c-fd869f525a53 req-d7428387-2692-4916-bf14-8c70dfa8c3e5 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received unexpected event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:40:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:40:49 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281649.396979, 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:40:49 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] VM Resumed (Lifecycle Event)
Apr 12 06:40:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-f711e68b-661f-4c4d-b27e-38b1ef456444 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:40:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:40:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:40:49 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 06:40:49 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281649.3979888, 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:40:49 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] VM Started (Lifecycle Event)
Apr 12 06:40:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:40:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:40:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-7a3c06d2-975d-48a0-a637-fc96f959fb36 req-9ec7bd6e-02bc-4cd3-b794-477fb3f33316 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7a3c06d2-975d-48a0-a637-fc96f959fb36 req-9ec7bd6e-02bc-4cd3-b794-477fb3f33316 service nova] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7a3c06d2-975d-48a0-a637-fc96f959fb36 req-9ec7bd6e-02bc-4cd3-b794-477fb3f33316 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7a3c06d2-975d-48a0-a637-fc96f959fb36 req-9ec7bd6e-02bc-4cd3-b794-477fb3f33316 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-7a3c06d2-975d-48a0-a637-fc96f959fb36 req-9ec7bd6e-02bc-4cd3-b794-477fb3f33316 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] No waiting events found dispatching network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:40:49 user nova-compute[71711]: WARNING nova.compute.manager [req-7a3c06d2-975d-48a0-a637-fc96f959fb36 req-9ec7bd6e-02bc-4cd3-b794-477fb3f33316 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received unexpected event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f for instance with vm_state active and task_state None.
Apr 12 06:40:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:50 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:40:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:40:54 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:40:54 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:40:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:40:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:40:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:40:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:40:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:40:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:40:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:55 user nova-compute[71711]: INFO nova.compute.manager [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Terminating instance
Apr 12 06:40:55 user nova-compute[71711]: DEBUG nova.compute.manager [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-81ab52cd-6f91-47ae-a03e-edd41c2b5390 req-85c4483f-9abb-4924-af91-6852a1ca4b45 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-unplugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-81ab52cd-6f91-47ae-a03e-edd41c2b5390 req-85c4483f-9abb-4924-af91-6852a1ca4b45 service nova] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-81ab52cd-6f91-47ae-a03e-edd41c2b5390 req-85c4483f-9abb-4924-af91-6852a1ca4b45 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-81ab52cd-6f91-47ae-a03e-edd41c2b5390 req-85c4483f-9abb-4924-af91-6852a1ca4b45 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-81ab52cd-6f91-47ae-a03e-edd41c2b5390 req-85c4483f-9abb-4924-af91-6852a1ca4b45 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] No waiting events found dispatching network-vif-unplugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-81ab52cd-6f91-47ae-a03e-edd41c2b5390 req-85c4483f-9abb-4924-af91-6852a1ca4b45 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-unplugged-f90233ae-9ecb-48be-baf0-7e517849679d for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:40:56 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Instance destroyed successfully.
Apr 12 06:40:56 user nova-compute[71711]: DEBUG nova.objects.instance [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lazy-loading 'resources' on Instance uuid 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:33:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1023741247',display_name='tempest-ServerStableDeviceRescueTest-server-1023741247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1023741247',id=27,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeOfWyak7L55BxU3CMZi8GQ9bZKqJlv/bIHJUXC8z3n705CqYiYWSJdMemQWwpBLyJE0B9ZyBbzqhcedALA6IEN7DJXMfRd9zTiTIeQNDyku00pbbHhb7qWZLZaOCMNzA==',key_name='tempest-keypair-966536347',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:37:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa21d19689b343dd935505ba458dd6af',ramdisk_id='',reservation_id='r-s9xyc36m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-88660584',owner_user_name='tempest-ServerStableDeviceRescueTest-88660584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:39:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ed0f651f79846138e3be8f312b3188f',uuid=4bef2d11-2dfe-47cb-a1ed-3331038ecd99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Converting VIF {"id": "f90233ae-9ecb-48be-baf0-7e517849679d", "address": "fa:16:3e:ba:90:6f", "network": {"id": "76d55312-0797-479f-852c-c1b78a76aa90", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2039919034-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa21d19689b343dd935505ba458dd6af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf90233ae-9e", "ovs_interfaceid": "f90233ae-9ecb-48be-baf0-7e517849679d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:90:6f,bridge_name='br-int',has_traffic_filtering=True,id=f90233ae-9ecb-48be-baf0-7e517849679d,network=Network(76d55312-0797-479f-852c-c1b78a76aa90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90233ae-9e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG os_vif [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:90:6f,bridge_name='br-int',has_traffic_filtering=True,id=f90233ae-9ecb-48be-baf0-7e517849679d,network=Network(76d55312-0797-479f-852c-c1b78a76aa90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90233ae-9e') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf90233ae-9e, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:40:56 user nova-compute[71711]: INFO os_vif [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:90:6f,bridge_name='br-int',has_traffic_filtering=True,id=f90233ae-9ecb-48be-baf0-7e517849679d,network=Network(76d55312-0797-479f-852c-c1b78a76aa90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf90233ae-9e')
Apr 12 06:40:56 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Deleting instance files /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99_del
Apr 12 06:40:56 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Deletion of /opt/stack/data/nova/instances/4bef2d11-2dfe-47cb-a1ed-3331038ecd99_del complete
Apr 12 06:40:56 user nova-compute[71711]: INFO nova.compute.manager [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 06:40:56 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:40:56 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:57 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Took 0.78 seconds to deallocate network for instance.
Apr 12 06:40:57 user nova-compute[71711]: DEBUG nova.compute.manager [req-69bfb2a6-8614-4273-89ff-c157bb214582 req-89a81af1-2076-420e-a388-18879f8aa0c8 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-deleted-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:40:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:58 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Deleted allocations for instance 4bef2d11-2dfe-47cb-a1ed-3331038ecd99
Apr 12 06:40:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-2236cfcf-f8c5-4b06-aeef-23bffe5bef36 req-0fb8b9b4-2ab3-4e4b-a911-102e32fc3eb0 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2236cfcf-f8c5-4b06-aeef-23bffe5bef36 req-0fb8b9b4-2ab3-4e4b-a911-102e32fc3eb0 service nova] Acquiring lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2236cfcf-f8c5-4b06-aeef-23bffe5bef36 req-0fb8b9b4-2ab3-4e4b-a911-102e32fc3eb0 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2236cfcf-f8c5-4b06-aeef-23bffe5bef36 req-0fb8b9b4-2ab3-4e4b-a911-102e32fc3eb0 service nova] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-2236cfcf-f8c5-4b06-aeef-23bffe5bef36 req-0fb8b9b4-2ab3-4e4b-a911-102e32fc3eb0 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] No waiting events found dispatching network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:40:58 user nova-compute[71711]: WARNING nova.compute.manager [req-2236cfcf-f8c5-4b06-aeef-23bffe5bef36 req-0fb8b9b4-2ab3-4e4b-a911-102e32fc3eb0 service nova] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Received unexpected event network-vif-plugged-f90233ae-9ecb-48be-baf0-7e517849679d for instance with vm_state deleted and task_state None.
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-841a3efe-f6cf-4a98-baf8-e40a6c0f5a5b tempest-ServerStableDeviceRescueTest-88660584 tempest-ServerStableDeviceRescueTest-88660584-project-member] Lock "4bef2d11-2dfe-47cb-a1ed-3331038ecd99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:58 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:40:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:40:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:40:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:40:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:40:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281644.9825733, f93121be-8fbc-4b92-856a-64bf9f192532 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:41:00 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] VM Stopped (Lifecycle Event)
Apr 12 06:41:00 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:41:00 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7980MB free_disk=26.0574951171875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e763458c-8246-4e02-bc82-51dcff305392 None None] [instance: f93121be-8fbc-4b92-856a-64bf9f192532] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Applying migration context for instance 51402ffe-ef35-41a3-811b-5a00788a13d8 as it has an incoming, in-progress migration b110bd15-f7b1-42c7-8ad7-36836b8cdaf5. Migration status is finished {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 06:41:00 user nova-compute[71711]: INFO nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Updating resource usage from migration b110bd15-f7b1-42c7-8ad7-36836b8cdaf5
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance faa2ad52-9528-4013-ad20-4a1d636aed14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 207359ea-0c81-46aa-a638-276957be0112 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Migration b110bd15-f7b1-42c7-8ad7-36836b8cdaf5 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:41:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:01 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:41:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:41:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:41:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:41:01 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:41:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:02 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Updating instance_info_cache with network_info: [{"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:41:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-ebb36f74-c4a3-4108-949d-1fb8918f9a8c" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:41:02 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:41:02 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:41:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:11 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281656.7396033, 4bef2d11-2dfe-47cb-a1ed-3331038ecd99 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:41:11 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] VM Stopped (Lifecycle Event)
Apr 12 06:41:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-89590899-3c7f-47f1-bf58-a6dd31e6a714 None None] [instance: 4bef2d11-2dfe-47cb-a1ed-3331038ecd99] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:41:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:41:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:41:33 user nova-compute[71711]: INFO nova.compute.manager [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Unrescuing
Apr 12 06:41:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "refresh_cache-207359ea-0c81-46aa-a638-276957be0112" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:41:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquired lock "refresh_cache-207359ea-0c81-46aa-a638-276957be0112" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:41:33 user nova-compute[71711]: DEBUG nova.network.neutron [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:41:34 user nova-compute[71711]: DEBUG nova.network.neutron [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Updating instance_info_cache with network_info: [{"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:41:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Releasing lock "refresh_cache-207359ea-0c81-46aa-a638-276957be0112" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:41:34 user nova-compute[71711]: DEBUG nova.objects.instance [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'flavor' on Instance uuid 207359ea-0c81-46aa-a638-276957be0112 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:41:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-329ed051-0769-4072-9b16-8af399410d22 req-3bf20ae0-cc90-410c-8079-d61b3538c6ea service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-unplugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:41:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-329ed051-0769-4072-9b16-8af399410d22 req-3bf20ae0-cc90-410c-8079-d61b3538c6ea service nova] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-329ed051-0769-4072-9b16-8af399410d22 req-3bf20ae0-cc90-410c-8079-d61b3538c6ea service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-329ed051-0769-4072-9b16-8af399410d22 req-3bf20ae0-cc90-410c-8079-d61b3538c6ea service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-329ed051-0769-4072-9b16-8af399410d22 req-3bf20ae0-cc90-410c-8079-d61b3538c6ea service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] No waiting events found dispatching network-vif-unplugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:41:34 user nova-compute[71711]: WARNING nova.compute.manager [req-329ed051-0769-4072-9b16-8af399410d22 req-3bf20ae0-cc90-410c-8079-d61b3538c6ea service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received unexpected event network-vif-unplugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:41:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:35 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 207359ea-0c81-46aa-a638-276957be0112] Instance destroyed successfully.
Apr 12 06:41:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:36 user nova-compute[71711]: DEBUG nova.compute.manager [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:41:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:36 user nova-compute[71711]: DEBUG nova.compute.manager [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] No waiting events found dispatching network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:41:36 user nova-compute[71711]: WARNING nova.compute.manager [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received unexpected event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:41:36 user nova-compute[71711]: DEBUG nova.compute.manager [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:41:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:36 user nova-compute[71711]: DEBUG nova.compute.manager [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] No waiting events found dispatching network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:41:36 user nova-compute[71711]: WARNING nova.compute.manager [req-6224ce5a-1ae4-4716-9d90-351a52971483 req-5abad7dd-00ac-4bbb-80e1-f336fe3b4deb service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received unexpected event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance with vm_state rescued and task_state unrescuing.
Apr 12 06:41:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:41:38 user nova-compute[71711]: INFO nova.compute.claims [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Claim successful on node user
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for 207359ea-0c81-46aa-a638-276957be0112 due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281698.4013736, 207359ea-0c81-46aa-a638-276957be0112 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:41:38 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] VM Resumed (Lifecycle Event)
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-f7d77ce7-39b1-4f17-91d1-f9ae992a978d tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:41:38 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281698.40275, 207359ea-0c81-46aa-a638-276957be0112 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:41:38 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] VM Started (Lifecycle Event)
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-df3c4b9e-1650-4464-b1fe-3044ff17058d req-340e2599-466e-4755-a797-cc5e1523f8a2 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-df3c4b9e-1650-4464-b1fe-3044ff17058d req-340e2599-466e-4755-a797-cc5e1523f8a2 service nova] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-df3c4b9e-1650-4464-b1fe-3044ff17058d req-340e2599-466e-4755-a797-cc5e1523f8a2 service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-df3c4b9e-1650-4464-b1fe-3044ff17058d req-340e2599-466e-4755-a797-cc5e1523f8a2 service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-df3c4b9e-1650-4464-b1fe-3044ff17058d req-340e2599-466e-4755-a797-cc5e1523f8a2 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] No waiting events found dispatching network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:41:38 user nova-compute[71711]: WARNING nova.compute.manager [req-df3c4b9e-1650-4464-b1fe-3044ff17058d req-340e2599-466e-4755-a797-cc5e1523f8a2 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received unexpected event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance with vm_state active and task_state None.
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.network.neutron [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:41:38 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:41:38 user nova-compute[71711]: DEBUG nova.policy [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6cd1f8b3c0d42298f6f4a303f1251ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267dce1303d451ca307eeaa38baf685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:41:39 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Creating image(s)
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "/opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "/opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.158s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk 1073741824" returned: 0 in 0.050s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.157s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG nova.network.neutron [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Successfully created port: 83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Cannot resize image /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'migration_context' on Instance uuid c6bc228c-8c66-45e3-9140-1dd5d321b2c8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Ensure instance console log exists: /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.network.neutron [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Successfully updated port: 83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "refresh_cache-c6bc228c-8c66-45e3-9140-1dd5d321b2c8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquired lock "refresh_cache-c6bc228c-8c66-45e3-9140-1dd5d321b2c8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.network.neutron [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Received event network-changed-83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Refreshing instance network info cache due to event network-changed-83ad8682-5a06-482a-969b-965968a4a243. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] Acquiring lock "refresh_cache-c6bc228c-8c66-45e3-9140-1dd5d321b2c8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.network.neutron [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.network.neutron [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Updating instance_info_cache with network_info: [{"id": "83ad8682-5a06-482a-969b-965968a4a243", "address": "fa:16:3e:3a:d2:7a", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ad8682-5a", "ovs_interfaceid": "83ad8682-5a06-482a-969b-965968a4a243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Releasing lock "refresh_cache-c6bc228c-8c66-45e3-9140-1dd5d321b2c8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Instance network_info: |[{"id": "83ad8682-5a06-482a-969b-965968a4a243", "address": "fa:16:3e:3a:d2:7a", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ad8682-5a", "ovs_interfaceid": "83ad8682-5a06-482a-969b-965968a4a243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] Acquired lock "refresh_cache-c6bc228c-8c66-45e3-9140-1dd5d321b2c8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.network.neutron [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Refreshing network info cache for port 83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Start _get_guest_xml network_info=[{"id": "83ad8682-5a06-482a-969b-965968a4a243", "address": "fa:16:3e:3a:d2:7a", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ad8682-5a", "ovs_interfaceid": "83ad8682-5a06-482a-969b-965968a4a243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:41:40 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:41:40 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:41:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-575862616',display_name='tempest-AttachVolumeNegativeTest-server-575862616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-575862616',id=34,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJovVVq9DlDt8OQJmv/ymM2orTxdeZEzo0KqhHfwyEqKcuzEEqG1eSncSTiiH+GPjR0VagPk4aBi/3x6BLntkCMzQHvNNCjXhV3C26xfCb1BqKX/0T8BZsCsPN0Rhy0ew==',key_name='tempest-keypair-1165194356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b267dce1303d451ca307eeaa38baf685',ramdisk_id='',reservation_id='r-01rcqvnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1905486920',owner_user_name='tempest-AttachVolumeNegativeTest-1905486920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:41:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',uuid=c6bc228c-8c66-45e3-9140-1dd5d321b2c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83ad8682-5a06-482a-969b-965968a4a243", "address": "fa:16:3e:3a:d2:7a", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ad8682-5a", "ovs_interfaceid": "83ad8682-5a06-482a-969b-965968a4a243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converting VIF {"id": "83ad8682-5a06-482a-969b-965968a4a243", "address": "fa:16:3e:3a:d2:7a", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ad8682-5a", "ovs_interfaceid": "83ad8682-5a06-482a-969b-965968a4a243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d2:7a,bridge_name='br-int',has_traffic_filtering=True,id=83ad8682-5a06-482a-969b-965968a4a243,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ad8682-5a') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.objects.instance [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'pci_devices' on Instance uuid c6bc228c-8c66-45e3-9140-1dd5d321b2c8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:41:40 user nova-compute[71711]:   <uuid>c6bc228c-8c66-45e3-9140-1dd5d321b2c8</uuid>
Apr 12 06:41:40 user nova-compute[71711]:   <name>instance-00000022</name>
Apr 12 06:41:40 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:41:40 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:41:40 user nova-compute[71711]:   <metadata>
Apr 12 06:41:40 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:41:40 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:41:40 user nova-compute[71711]:       <nova:name>tempest-AttachVolumeNegativeTest-server-575862616</nova:name>
Apr 12 06:41:40 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:41:40</nova:creationTime>
Apr 12 06:41:40 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:41:40 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:41:40 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:41:40 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:41:40 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:41:40 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:41:40 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:41:40 user nova-compute[71711]:       <nova:owner>
Apr 12 06:41:40 user nova-compute[71711]:         <nova:user uuid="d6cd1f8b3c0d42298f6f4a303f1251ec">tempest-AttachVolumeNegativeTest-1905486920-project-member</nova:user>
Apr 12 06:41:40 user nova-compute[71711]:         <nova:project uuid="b267dce1303d451ca307eeaa38baf685">tempest-AttachVolumeNegativeTest-1905486920</nova:project>
Apr 12 06:41:40 user nova-compute[71711]:       </nova:owner>
Apr 12 06:41:40 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:41:40 user nova-compute[71711]:       <nova:ports>
Apr 12 06:41:40 user nova-compute[71711]:         <nova:port uuid="83ad8682-5a06-482a-969b-965968a4a243">
Apr 12 06:41:40 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 06:41:40 user nova-compute[71711]:         </nova:port>
Apr 12 06:41:40 user nova-compute[71711]:       </nova:ports>
Apr 12 06:41:40 user nova-compute[71711]:     </nova:instance>
Apr 12 06:41:40 user nova-compute[71711]:   </metadata>
Apr 12 06:41:40 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:41:40 user nova-compute[71711]:     <system>
Apr 12 06:41:40 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:41:40 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:41:40 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:41:40 user nova-compute[71711]:       <entry name="serial">c6bc228c-8c66-45e3-9140-1dd5d321b2c8</entry>
Apr 12 06:41:40 user nova-compute[71711]:       <entry name="uuid">c6bc228c-8c66-45e3-9140-1dd5d321b2c8</entry>
Apr 12 06:41:40 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:41:40 user nova-compute[71711]:     </system>
Apr 12 06:41:40 user nova-compute[71711]:   </sysinfo>
Apr 12 06:41:40 user nova-compute[71711]:   <os>
Apr 12 06:41:40 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:41:40 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:41:40 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:41:40 user nova-compute[71711]:   </os>
Apr 12 06:41:40 user nova-compute[71711]:   <features>
Apr 12 06:41:40 user nova-compute[71711]:     <acpi/>
Apr 12 06:41:40 user nova-compute[71711]:     <apic/>
Apr 12 06:41:40 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:41:40 user nova-compute[71711]:   </features>
Apr 12 06:41:40 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:41:40 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:41:40 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:41:40 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:41:40 user nova-compute[71711]:   </clock>
Apr 12 06:41:40 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:41:40 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:41:40 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:41:40 user nova-compute[71711]:   </cpu>
Apr 12 06:41:40 user nova-compute[71711]:   <devices>
Apr 12 06:41:40 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:41:40 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:41:40 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk"/>
Apr 12 06:41:40 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:41:40 user nova-compute[71711]:     </disk>
Apr 12 06:41:40 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:41:40 user nova-compute[71711]:       <mac address="fa:16:3e:3a:d2:7a"/>
Apr 12 06:41:40 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:41:40 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:41:40 user nova-compute[71711]:       <target dev="tap83ad8682-5a"/>
Apr 12 06:41:40 user nova-compute[71711]:     </interface>
Apr 12 06:41:40 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:41:40 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/console.log" append="off"/>
Apr 12 06:41:40 user nova-compute[71711]:     </serial>
Apr 12 06:41:40 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:41:40 user nova-compute[71711]:     <video>
Apr 12 06:41:40 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:41:40 user nova-compute[71711]:     </video>
Apr 12 06:41:40 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:41:40 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:41:40 user nova-compute[71711]:     </rng>
Apr 12 06:41:40 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:41:40 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:41:40 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:41:40 user nova-compute[71711]:     </memballoon>
Apr 12 06:41:40 user nova-compute[71711]:   </devices>
Apr 12 06:41:40 user nova-compute[71711]: </domain>
Apr 12 06:41:40 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:41:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-575862616',display_name='tempest-AttachVolumeNegativeTest-server-575862616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-575862616',id=34,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJovVVq9DlDt8OQJmv/ymM2orTxdeZEzo0KqhHfwyEqKcuzEEqG1eSncSTiiH+GPjR0VagPk4aBi/3x6BLntkCMzQHvNNCjXhV3C26xfCb1BqKX/0T8BZsCsPN0Rhy0ew==',key_name='tempest-keypair-1165194356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b267dce1303d451ca307eeaa38baf685',ramdisk_id='',reservation_id='r-01rcqvnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1905486920',owner_user_name='tempest-AttachVolumeNegativeTest-1905486920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:41:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',uuid=c6bc228c-8c66-45e3-9140-1dd5d321b2c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83ad8682-5a06-482a-969b-965968a4a243", "address": "fa:16:3e:3a:d2:7a", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ad8682-5a", "ovs_interfaceid": "83ad8682-5a06-482a-969b-965968a4a243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converting VIF {"id": "83ad8682-5a06-482a-969b-965968a4a243", "address": "fa:16:3e:3a:d2:7a", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ad8682-5a", "ovs_interfaceid": "83ad8682-5a06-482a-969b-965968a4a243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d2:7a,bridge_name='br-int',has_traffic_filtering=True,id=83ad8682-5a06-482a-969b-965968a4a243,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ad8682-5a') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG os_vif [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d2:7a,bridge_name='br-int',has_traffic_filtering=True,id=83ad8682-5a06-482a-969b-965968a4a243,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ad8682-5a') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83ad8682-5a, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83ad8682-5a, col_values=(('external_ids', {'iface-id': '83ad8682-5a06-482a-969b-965968a4a243', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:d2:7a', 'vm-uuid': 'c6bc228c-8c66-45e3-9140-1dd5d321b2c8'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:40 user nova-compute[71711]: INFO os_vif [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d2:7a,bridge_name='br-int',has_traffic_filtering=True,id=83ad8682-5a06-482a-969b-965968a4a243,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ad8682-5a')
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:41:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No VIF found with MAC fa:16:3e:3a:d2:7a, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:41:41 user nova-compute[71711]: DEBUG nova.network.neutron [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Updated VIF entry in instance network info cache for port 83ad8682-5a06-482a-969b-965968a4a243. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:41:41 user nova-compute[71711]: DEBUG nova.network.neutron [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Updating instance_info_cache with network_info: [{"id": "83ad8682-5a06-482a-969b-965968a4a243", "address": "fa:16:3e:3a:d2:7a", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ad8682-5a", "ovs_interfaceid": "83ad8682-5a06-482a-969b-965968a4a243", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:41:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5d87e292-6b6d-4f62-95d8-b790ec5fd8f8 req-19f39b14-aaf3-4121-b69e-af05129a9750 service nova] Releasing lock "refresh_cache-c6bc228c-8c66-45e3-9140-1dd5d321b2c8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:41:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-fd889f90-c38e-45c3-b132-47a0413bd12f req-d6082386-19d3-49e6-bf78-ff56008c8432 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Received event network-vif-plugged-83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:41:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fd889f90-c38e-45c3-b132-47a0413bd12f req-d6082386-19d3-49e6-bf78-ff56008c8432 service nova] Acquiring lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fd889f90-c38e-45c3-b132-47a0413bd12f req-d6082386-19d3-49e6-bf78-ff56008c8432 service nova] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fd889f90-c38e-45c3-b132-47a0413bd12f req-d6082386-19d3-49e6-bf78-ff56008c8432 service nova] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-fd889f90-c38e-45c3-b132-47a0413bd12f req-d6082386-19d3-49e6-bf78-ff56008c8432 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] No waiting events found dispatching network-vif-plugged-83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:41:42 user nova-compute[71711]: WARNING nova.compute.manager [req-fd889f90-c38e-45c3-b132-47a0413bd12f req-d6082386-19d3-49e6-bf78-ff56008c8432 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Received unexpected event network-vif-plugged-83ad8682-5a06-482a-969b-965968a4a243 for instance with vm_state building and task_state spawning.
Apr 12 06:41:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281704.4898927, c6bc228c-8c66-45e3-9140-1dd5d321b2c8 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:41:44 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] VM Resumed (Lifecycle Event)
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:41:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Instance spawned successfully.
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:41:44 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281704.4953408, c6bc228c-8c66-45e3-9140-1dd5d321b2c8 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:41:44 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] VM Started (Lifecycle Event)
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:41:44 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-fbd0b6c5-4984-4e82-8db4-c1eff10d0666 req-590db2fa-b6fc-4dc8-9a59-f0b5e7bbdd88 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Received event network-vif-plugged-83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fbd0b6c5-4984-4e82-8db4-c1eff10d0666 req-590db2fa-b6fc-4dc8-9a59-f0b5e7bbdd88 service nova] Acquiring lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fbd0b6c5-4984-4e82-8db4-c1eff10d0666 req-590db2fa-b6fc-4dc8-9a59-f0b5e7bbdd88 service nova] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fbd0b6c5-4984-4e82-8db4-c1eff10d0666 req-590db2fa-b6fc-4dc8-9a59-f0b5e7bbdd88 service nova] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-fbd0b6c5-4984-4e82-8db4-c1eff10d0666 req-590db2fa-b6fc-4dc8-9a59-f0b5e7bbdd88 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] No waiting events found dispatching network-vif-plugged-83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:41:44 user nova-compute[71711]: WARNING nova.compute.manager [req-fbd0b6c5-4984-4e82-8db4-c1eff10d0666 req-590db2fa-b6fc-4dc8-9a59-f0b5e7bbdd88 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Received unexpected event network-vif-plugged-83ad8682-5a06-482a-969b-965968a4a243 for instance with vm_state building and task_state spawning.
Apr 12 06:41:44 user nova-compute[71711]: INFO nova.compute.manager [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Took 5.57 seconds to spawn the instance on the hypervisor.
Apr 12 06:41:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:41:44 user nova-compute[71711]: INFO nova.compute.manager [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Took 6.37 seconds to build instance.
Apr 12 06:41:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-ef935d94-0f53-4913-bad8-fd1ee4a1bfca tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.464s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:51 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:41:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Going to confirm migration 2 {{(pid=71711) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 12 06:41:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:41:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquired lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:41:52 user nova-compute[71711]: DEBUG nova.network.neutron [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:41:52 user nova-compute[71711]: DEBUG nova.objects.instance [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'info_cache' on Instance uuid 51402ffe-ef35-41a3-811b-5a00788a13d8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:41:53 user nova-compute[71711]: DEBUG nova.network.neutron [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Updating instance_info_cache with network_info: [{"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:41:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Releasing lock "refresh_cache-51402ffe-ef35-41a3-811b-5a00788a13d8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:41:53 user nova-compute[71711]: DEBUG nova.objects.instance [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'migration_context' on Instance uuid 51402ffe-ef35-41a3-811b-5a00788a13d8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:41:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:53 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:41:53 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:41:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.377s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:53 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Deleted allocation for migration b110bd15-f7b1-42c7-8ad7-36836b8cdaf5
Apr 12 06:41:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-47ed2172-4709-4cf9-a93b-b3cc2cb65860 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.462s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:54 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:41:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:55 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:41:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:41:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:41:58 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:41:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:42:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:42:02 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:42:02 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7944MB free_disk=26.026519775390625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance faa2ad52-9528-4013-ad20-4a1d636aed14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 207359ea-0c81-46aa-a638-276957be0112 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:42:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:42:03 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:42:03 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:42:03 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:42:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-faa2ad52-9528-4013-ad20-4a1d636aed14" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:42:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-faa2ad52-9528-4013-ad20-4a1d636aed14" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:42:03 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:42:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:04 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Updating instance_info_cache with network_info: [{"id": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "address": "fa:16:3e:d7:dc:4b", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07855ce5-96", "ovs_interfaceid": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:42:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-faa2ad52-9528-4013-ad20-4a1d636aed14" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:42:04 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:42:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:42:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:42:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:42:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:42:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:42:14 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:42:14 user nova-compute[71711]: INFO nova.compute.claims [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Claim successful on node user
Apr 12 06:42:14 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:42:14 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:42:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:42:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:42:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:42:14 user nova-compute[71711]: DEBUG nova.network.neutron [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:42:14 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:42:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG nova.policy [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8546fd1ed08b4e88a945e73347be38c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34529636fc4221921028f93b1c381a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:42:15 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Creating image(s)
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "/opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "/opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk 1073741824" returned: 0 in 0.050s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.154s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG nova.network.neutron [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Successfully created port: 8cec16af-061e-4a14-bf55-f33bd17192e7 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Cannot resize image /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG nova.objects.instance [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'migration_context' on Instance uuid bbb5bae3-4c69-429d-b71c-8dee3437aff8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Ensure instance console log exists: /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:42:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.network.neutron [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Successfully updated port: 8cec16af-061e-4a14-bf55-f33bd17192e7 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "refresh_cache-bbb5bae3-4c69-429d-b71c-8dee3437aff8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquired lock "refresh_cache-bbb5bae3-4c69-429d-b71c-8dee3437aff8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.network.neutron [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.compute.manager [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Received event network-changed-8cec16af-061e-4a14-bf55-f33bd17192e7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.compute.manager [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Refreshing instance network info cache due to event network-changed-8cec16af-061e-4a14-bf55-f33bd17192e7. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] Acquiring lock "refresh_cache-bbb5bae3-4c69-429d-b71c-8dee3437aff8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.network.neutron [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.network.neutron [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Updating instance_info_cache with network_info: [{"id": "8cec16af-061e-4a14-bf55-f33bd17192e7", "address": "fa:16:3e:a5:67:ba", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cec16af-06", "ovs_interfaceid": "8cec16af-061e-4a14-bf55-f33bd17192e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Releasing lock "refresh_cache-bbb5bae3-4c69-429d-b71c-8dee3437aff8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Instance network_info: |[{"id": "8cec16af-061e-4a14-bf55-f33bd17192e7", "address": "fa:16:3e:a5:67:ba", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cec16af-06", "ovs_interfaceid": "8cec16af-061e-4a14-bf55-f33bd17192e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] Acquired lock "refresh_cache-bbb5bae3-4c69-429d-b71c-8dee3437aff8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.network.neutron [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Refreshing network info cache for port 8cec16af-061e-4a14-bf55-f33bd17192e7 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Start _get_guest_xml network_info=[{"id": "8cec16af-061e-4a14-bf55-f33bd17192e7", "address": "fa:16:3e:a5:67:ba", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cec16af-06", "ovs_interfaceid": "8cec16af-061e-4a14-bf55-f33bd17192e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:42:16 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:42:16 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-69068700',display_name='tempest-VolumesSnapshotTestJSON-instance-69068700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-69068700',id=35,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af34529636fc4221921028f93b1c381a',ramdisk_id='',reservation_id='r-jjjyze9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2015355536',owner_user_name='tempest-VolumesSnapshotTestJSON-2015355536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:42:15Z,user_data=None,user_id='8546fd1ed08b4e88a945e73347be38c2',uuid=bbb5bae3-4c69-429d-b71c-8dee3437aff8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cec16af-061e-4a14-bf55-f33bd17192e7", "address": "fa:16:3e:a5:67:ba", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cec16af-06", "ovs_interfaceid": "8cec16af-061e-4a14-bf55-f33bd17192e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Converting VIF {"id": "8cec16af-061e-4a14-bf55-f33bd17192e7", "address": "fa:16:3e:a5:67:ba", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cec16af-06", "ovs_interfaceid": "8cec16af-061e-4a14-bf55-f33bd17192e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:67:ba,bridge_name='br-int',has_traffic_filtering=True,id=8cec16af-061e-4a14-bf55-f33bd17192e7,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cec16af-06') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.objects.instance [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'pci_devices' on Instance uuid bbb5bae3-4c69-429d-b71c-8dee3437aff8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:42:16 user nova-compute[71711]:   <uuid>bbb5bae3-4c69-429d-b71c-8dee3437aff8</uuid>
Apr 12 06:42:16 user nova-compute[71711]:   <name>instance-00000023</name>
Apr 12 06:42:16 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:42:16 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:42:16 user nova-compute[71711]:   <metadata>
Apr 12 06:42:16 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:42:16 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:42:16 user nova-compute[71711]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-69068700</nova:name>
Apr 12 06:42:16 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:42:16</nova:creationTime>
Apr 12 06:42:16 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:42:16 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:42:16 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:42:16 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:42:16 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:42:16 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:42:16 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:42:16 user nova-compute[71711]:       <nova:owner>
Apr 12 06:42:16 user nova-compute[71711]:         <nova:user uuid="8546fd1ed08b4e88a945e73347be38c2">tempest-VolumesSnapshotTestJSON-2015355536-project-member</nova:user>
Apr 12 06:42:16 user nova-compute[71711]:         <nova:project uuid="af34529636fc4221921028f93b1c381a">tempest-VolumesSnapshotTestJSON-2015355536</nova:project>
Apr 12 06:42:16 user nova-compute[71711]:       </nova:owner>
Apr 12 06:42:16 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:42:16 user nova-compute[71711]:       <nova:ports>
Apr 12 06:42:16 user nova-compute[71711]:         <nova:port uuid="8cec16af-061e-4a14-bf55-f33bd17192e7">
Apr 12 06:42:16 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 06:42:16 user nova-compute[71711]:         </nova:port>
Apr 12 06:42:16 user nova-compute[71711]:       </nova:ports>
Apr 12 06:42:16 user nova-compute[71711]:     </nova:instance>
Apr 12 06:42:16 user nova-compute[71711]:   </metadata>
Apr 12 06:42:16 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:42:16 user nova-compute[71711]:     <system>
Apr 12 06:42:16 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:42:16 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:42:16 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:42:16 user nova-compute[71711]:       <entry name="serial">bbb5bae3-4c69-429d-b71c-8dee3437aff8</entry>
Apr 12 06:42:16 user nova-compute[71711]:       <entry name="uuid">bbb5bae3-4c69-429d-b71c-8dee3437aff8</entry>
Apr 12 06:42:16 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:42:16 user nova-compute[71711]:     </system>
Apr 12 06:42:16 user nova-compute[71711]:   </sysinfo>
Apr 12 06:42:16 user nova-compute[71711]:   <os>
Apr 12 06:42:16 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:42:16 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:42:16 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:42:16 user nova-compute[71711]:   </os>
Apr 12 06:42:16 user nova-compute[71711]:   <features>
Apr 12 06:42:16 user nova-compute[71711]:     <acpi/>
Apr 12 06:42:16 user nova-compute[71711]:     <apic/>
Apr 12 06:42:16 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:42:16 user nova-compute[71711]:   </features>
Apr 12 06:42:16 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:42:16 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:42:16 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:42:16 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:42:16 user nova-compute[71711]:   </clock>
Apr 12 06:42:16 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:42:16 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:42:16 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:42:16 user nova-compute[71711]:   </cpu>
Apr 12 06:42:16 user nova-compute[71711]:   <devices>
Apr 12 06:42:16 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:42:16 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:42:16 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk"/>
Apr 12 06:42:16 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:42:16 user nova-compute[71711]:     </disk>
Apr 12 06:42:16 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:42:16 user nova-compute[71711]:       <mac address="fa:16:3e:a5:67:ba"/>
Apr 12 06:42:16 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:42:16 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:42:16 user nova-compute[71711]:       <target dev="tap8cec16af-06"/>
Apr 12 06:42:16 user nova-compute[71711]:     </interface>
Apr 12 06:42:16 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:42:16 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/console.log" append="off"/>
Apr 12 06:42:16 user nova-compute[71711]:     </serial>
Apr 12 06:42:16 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:42:16 user nova-compute[71711]:     <video>
Apr 12 06:42:16 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:42:16 user nova-compute[71711]:     </video>
Apr 12 06:42:16 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:42:16 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:42:16 user nova-compute[71711]:     </rng>
Apr 12 06:42:16 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:42:16 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:42:16 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:42:16 user nova-compute[71711]:     </memballoon>
Apr 12 06:42:16 user nova-compute[71711]:   </devices>
Apr 12 06:42:16 user nova-compute[71711]: </domain>
Apr 12 06:42:16 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-69068700',display_name='tempest-VolumesSnapshotTestJSON-instance-69068700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-69068700',id=35,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af34529636fc4221921028f93b1c381a',ramdisk_id='',reservation_id='r-jjjyze9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2015355536',owner_user_name='tempest-VolumesSnapshotTestJSON-2015355536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:42:15Z,user_data=None,user_id='8546fd1ed08b4e88a945e73347be38c2',uuid=bbb5bae3-4c69-429d-b71c-8dee3437aff8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cec16af-061e-4a14-bf55-f33bd17192e7", "address": "fa:16:3e:a5:67:ba", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cec16af-06", "ovs_interfaceid": "8cec16af-061e-4a14-bf55-f33bd17192e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Converting VIF {"id": "8cec16af-061e-4a14-bf55-f33bd17192e7", "address": "fa:16:3e:a5:67:ba", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cec16af-06", "ovs_interfaceid": "8cec16af-061e-4a14-bf55-f33bd17192e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:67:ba,bridge_name='br-int',has_traffic_filtering=True,id=8cec16af-061e-4a14-bf55-f33bd17192e7,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cec16af-06') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG os_vif [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:67:ba,bridge_name='br-int',has_traffic_filtering=True,id=8cec16af-061e-4a14-bf55-f33bd17192e7,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cec16af-06') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cec16af-06, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8cec16af-06, col_values=(('external_ids', {'iface-id': '8cec16af-061e-4a14-bf55-f33bd17192e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:67:ba', 'vm-uuid': 'bbb5bae3-4c69-429d-b71c-8dee3437aff8'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:16 user nova-compute[71711]: INFO os_vif [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:67:ba,bridge_name='br-int',has_traffic_filtering=True,id=8cec16af-061e-4a14-bf55-f33bd17192e7,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cec16af-06')
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:42:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] No VIF found with MAC fa:16:3e:a5:67:ba, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:42:17 user nova-compute[71711]: DEBUG nova.network.neutron [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Updated VIF entry in instance network info cache for port 8cec16af-061e-4a14-bf55-f33bd17192e7. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:42:17 user nova-compute[71711]: DEBUG nova.network.neutron [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Updating instance_info_cache with network_info: [{"id": "8cec16af-061e-4a14-bf55-f33bd17192e7", "address": "fa:16:3e:a5:67:ba", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cec16af-06", "ovs_interfaceid": "8cec16af-061e-4a14-bf55-f33bd17192e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:42:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b44d618f-d474-4744-aea3-72f2ec4f141b req-817affca-ebe5-403e-9f42-218b9912577b service nova] Releasing lock "refresh_cache-bbb5bae3-4c69-429d-b71c-8dee3437aff8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:42:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-7c18d7d8-087d-47f2-95e2-0d309bbd94aa req-ab6eddb8-817d-428e-89b0-1ec9d5a1606e service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Received event network-vif-plugged-8cec16af-061e-4a14-bf55-f33bd17192e7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:42:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7c18d7d8-087d-47f2-95e2-0d309bbd94aa req-ab6eddb8-817d-428e-89b0-1ec9d5a1606e service nova] Acquiring lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:42:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7c18d7d8-087d-47f2-95e2-0d309bbd94aa req-ab6eddb8-817d-428e-89b0-1ec9d5a1606e service nova] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:42:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-7c18d7d8-087d-47f2-95e2-0d309bbd94aa req-ab6eddb8-817d-428e-89b0-1ec9d5a1606e service nova] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:42:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-7c18d7d8-087d-47f2-95e2-0d309bbd94aa req-ab6eddb8-817d-428e-89b0-1ec9d5a1606e service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] No waiting events found dispatching network-vif-plugged-8cec16af-061e-4a14-bf55-f33bd17192e7 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:42:18 user nova-compute[71711]: WARNING nova.compute.manager [req-7c18d7d8-087d-47f2-95e2-0d309bbd94aa req-ab6eddb8-817d-428e-89b0-1ec9d5a1606e service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Received unexpected event network-vif-plugged-8cec16af-061e-4a14-bf55-f33bd17192e7 for instance with vm_state building and task_state spawning.
Apr 12 06:42:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281740.3001025, bbb5bae3-4c69-429d-b71c-8dee3437aff8 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:42:20 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] VM Resumed (Lifecycle Event)
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:42:20 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Instance spawned successfully.
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:42:20 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281740.3015368, bbb5bae3-4c69-429d-b71c-8dee3437aff8 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:42:20 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] VM Started (Lifecycle Event)
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:42:20 user nova-compute[71711]: INFO nova.compute.manager [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Took 5.39 seconds to spawn the instance on the hypervisor.
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:42:20 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-785599a6-7dff-4a24-b410-cadb739b6f66 req-072de8bd-bc03-4744-a2db-49bf1866849a service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Received event network-vif-plugged-8cec16af-061e-4a14-bf55-f33bd17192e7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-785599a6-7dff-4a24-b410-cadb739b6f66 req-072de8bd-bc03-4744-a2db-49bf1866849a service nova] Acquiring lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-785599a6-7dff-4a24-b410-cadb739b6f66 req-072de8bd-bc03-4744-a2db-49bf1866849a service nova] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-785599a6-7dff-4a24-b410-cadb739b6f66 req-072de8bd-bc03-4744-a2db-49bf1866849a service nova] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:42:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-785599a6-7dff-4a24-b410-cadb739b6f66 req-072de8bd-bc03-4744-a2db-49bf1866849a service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] No waiting events found dispatching network-vif-plugged-8cec16af-061e-4a14-bf55-f33bd17192e7 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:42:20 user nova-compute[71711]: WARNING nova.compute.manager [req-785599a6-7dff-4a24-b410-cadb739b6f66 req-072de8bd-bc03-4744-a2db-49bf1866849a service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Received unexpected event network-vif-plugged-8cec16af-061e-4a14-bf55-f33bd17192e7 for instance with vm_state building and task_state spawning.
Apr 12 06:42:20 user nova-compute[71711]: INFO nova.compute.manager [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Took 6.10 seconds to build instance.
Apr 12 06:42:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-92493ede-2be7-4a4e-8485-93c1022b616b tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.198s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:42:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:36 user nova-compute[71711]: DEBUG nova.compute.manager [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-changed-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:42:36 user nova-compute[71711]: DEBUG nova.compute.manager [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Refreshing instance network info cache due to event network-changed-4d362992-cbb4-4530-b971-86688508274f. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:42:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] Acquiring lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:42:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] Acquired lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:42:36 user nova-compute[71711]: DEBUG nova.network.neutron [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Refreshing network info cache for port 4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:42:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:42:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:42:36 user nova-compute[71711]: INFO nova.compute.manager [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Detaching volume 4e3910db-ed08-4a5a-bb85-48c49eccbf9a
Apr 12 06:42:36 user nova-compute[71711]: DEBUG nova.network.neutron [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Updated VIF entry in instance network info cache for port 4d362992-cbb4-4530-b971-86688508274f. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:42:36 user nova-compute[71711]: DEBUG nova.network.neutron [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Updating instance_info_cache with network_info: [{"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:42:36 user nova-compute[71711]: INFO nova.virt.block_device [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Attempting to driver detach volume 4e3910db-ed08-4a5a-bb85-48c49eccbf9a from mountpoint /dev/vdb
Apr 12 06:42:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-478bdcf7-05d2-4210-ad2b-d1b9905ea060 req-d81d6a3e-7a53-4f57-983d-dd8d55a493a6 service nova] Releasing lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:42:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Attempting to detach device vdb from instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:42:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:42:36 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:42:36 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:42:36 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:42:36 user nova-compute[71711]:   <serial>4e3910db-ed08-4a5a-bb85-48c49eccbf9a</serial>
Apr 12 06:42:36 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:42:36 user nova-compute[71711]: </disk>
Apr 12 06:42:36 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:42:36 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Successfully detached device vdb from instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 from the persistent domain config.
Apr 12 06:42:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:42:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:42:36 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:42:36 user nova-compute[71711]:   <source dev="/dev/sdf"/>
Apr 12 06:42:36 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:42:36 user nova-compute[71711]:   <serial>4e3910db-ed08-4a5a-bb85-48c49eccbf9a</serial>
Apr 12 06:42:36 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:42:36 user nova-compute[71711]: </disk>
Apr 12 06:42:36 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:42:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681281757.1600409, 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:42:37 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Successfully detached device vdb from instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 from the live domain config.
Apr 12 06:42:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NilzYZIx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:42:37 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdd8461-62e5-4563-9f5a-60264108ce61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:42:37 user nova-compute[71711]: No targets found.
Apr 12 06:42:37 user nova-compute[71711]: iSNS:
Apr 12 06:42:37 user nova-compute[71711]: No targets found.
Apr 12 06:42:37 user nova-compute[71711]: STATIC:
Apr 12 06:42:37 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7
Apr 12 06:42:37 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:42:37 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:42:37 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a
Apr 12 06:42:37 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:42:37 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:42:37 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31
Apr 12 06:42:37 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:42:37 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:42:37 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:42:37 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:42:37 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:42:37 user nova-compute[71711]: FIRMWARE:
Apr 12 06:42:37 user nova-compute[71711]: No targets found.
Apr 12 06:42:37 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:42:37 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:42:37 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c350a7-b319-46e0-bdb6-7d1738f60dd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[987202f5-0ac4-4190-b164-66b37d63d28d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:42:37 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:42:37 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:42:37 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:42:37 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:42:37 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:42:37 user nova-compute[71711]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a (non-flash)
Apr 12 06:42:37 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:42:37 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c205870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a'): ({'sdf'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Removing single pathed devices sdf {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ff1574-fdbe-46ed-a625-50f0a1063cbf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca17d78-b490-4afb-8683-93afe0eb4430]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Flushing IO for device /dev/sdf {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98d0c65-b05b-4406-bde7-a19af39b2ca1]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e90774d-c626-4530-b870-44558bdc6330]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] SCSI volumes sdf have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8885c91-489b-4da1-b35e-869ec617307e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe57f922-126b-4fc3-a80e-10e680950066]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a, portal: 172.16.0.220,3260]
Apr 12 06:42:37 user nova-compute[71711]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a, portal: 172.16.0.220,3260] successful.
Apr 12 06:42:37 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e3910db-ed08-4a5a-bb85-48c49eccbf9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6010ac64-cfc5-48b8-a91c-b3752a0f0f5f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] <== disconnect_volume: return (310ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:42:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:42:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-changed-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:42:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Refreshing instance network info cache due to event network-changed-4d362992-cbb4-4530-b971-86688508274f. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:42:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] Acquiring lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:42:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] Acquired lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:42:38 user nova-compute[71711]: DEBUG nova.network.neutron [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Refreshing network info cache for port 4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:42:38 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'flavor' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:42:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1cd50387-99a8-4587-821f-2e17a7ffd9a4 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.691s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:42:39 user nova-compute[71711]: DEBUG nova.network.neutron [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Updated VIF entry in instance network info cache for port 4d362992-cbb4-4530-b971-86688508274f. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:42:39 user nova-compute[71711]: DEBUG nova.network.neutron [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Updating instance_info_cache with network_info: [{"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:42:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b865f7aa-8662-4924-b8cb-cb4d44ea94d2 req-9b833239-d41a-4d3e-b9c2-1ba84bd5fd2e service nova] Releasing lock "refresh_cache-8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:42:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:48 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:42:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:51 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:42:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:54 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:42:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:42:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:42:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:42:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:42:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:42:57 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:42:58 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:42:58 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:42:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:42:59 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:00 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:43:02 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:43:02 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=7964MB free_disk=26.0052490234375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance faa2ad52-9528-4013-ad20-4a1d636aed14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 207359ea-0c81-46aa-a638-276957be0112 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing inventories for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating ProviderTree inventory for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating inventory in ProviderTree for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing aggregate associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, aggregates: None {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 06:43:02 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing trait associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, traits: HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 06:43:03 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:43:03 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:43:03 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:43:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.729s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:43:05 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:43:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:43:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:43:05 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:43:05 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Updating instance_info_cache with network_info: [{"id": "744814ae-b032-41e5-b122-8d5ff605d349", "address": "fa:16:3e:c2:8c:71", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744814ae-b0", "ovs_interfaceid": "744814ae-b032-41e5-b122-8d5ff605d349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:43:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-659489bb-3672-4f70-9ab5-b37f310a7d86" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:43:05 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:43:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:43:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:43:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:43:05 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 06:43:05 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] There are 0 instances to clean {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 06:43:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:07 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:43:07 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71711) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 06:43:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "207359ea-0c81-46aa-a638-276957be0112" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "207359ea-0c81-46aa-a638-276957be0112-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "207359ea-0c81-46aa-a638-276957be0112-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:24 user nova-compute[71711]: INFO nova.compute.manager [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Terminating instance
Apr 12 06:43:24 user nova-compute[71711]: DEBUG nova.compute.manager [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:43:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3f2dee9-a896-44e4-a681-d0f7512b676a req-ca8a7ca0-cfca-4001-ba2a-4826de749f21 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-unplugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3f2dee9-a896-44e4-a681-d0f7512b676a req-ca8a7ca0-cfca-4001-ba2a-4826de749f21 service nova] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3f2dee9-a896-44e4-a681-d0f7512b676a req-ca8a7ca0-cfca-4001-ba2a-4826de749f21 service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e3f2dee9-a896-44e4-a681-d0f7512b676a req-ca8a7ca0-cfca-4001-ba2a-4826de749f21 service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3f2dee9-a896-44e4-a681-d0f7512b676a req-ca8a7ca0-cfca-4001-ba2a-4826de749f21 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] No waiting events found dispatching network-vif-unplugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-e3f2dee9-a896-44e4-a681-d0f7512b676a req-ca8a7ca0-cfca-4001-ba2a-4826de749f21 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-unplugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:25 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 207359ea-0c81-46aa-a638-276957be0112] Instance destroyed successfully.
Apr 12 06:43:25 user nova-compute[71711]: DEBUG nova.objects.instance [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'resources' on Instance uuid 207359ea-0c81-46aa-a638-276957be0112 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:37:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1451717232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1451717232',id=32,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:39:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-d5n9p9t2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:41:38Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=207359ea-0c81-46aa-a638-276957be0112,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "address": "fa:16:3e:75:b7:30", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9933569-0e", "ovs_interfaceid": "b9933569-0e24-4acb-b85d-ccb1eb9c5721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:b7:30,bridge_name='br-int',has_traffic_filtering=True,id=b9933569-0e24-4acb-b85d-ccb1eb9c5721,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9933569-0e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_vif [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:b7:30,bridge_name='br-int',has_traffic_filtering=True,id=b9933569-0e24-4acb-b85d-ccb1eb9c5721,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9933569-0e') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9933569-0e, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:43:25 user nova-compute[71711]: INFO os_vif [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:b7:30,bridge_name='br-int',has_traffic_filtering=True,id=b9933569-0e24-4acb-b85d-ccb1eb9c5721,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9933569-0e')
Apr 12 06:43:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHIBytCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:43:25 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b64b11b-a499-494c-b50b-c4fa0a117083]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:43:25 user nova-compute[71711]: No targets found.
Apr 12 06:43:25 user nova-compute[71711]: iSNS:
Apr 12 06:43:25 user nova-compute[71711]: No targets found.
Apr 12 06:43:25 user nova-compute[71711]: STATIC:
Apr 12 06:43:25 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7
Apr 12 06:43:25 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:43:25 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:43:25 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31
Apr 12 06:43:25 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:43:25 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:43:25 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:43:25 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:43:25 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:43:25 user nova-compute[71711]: FIRMWARE:
Apr 12 06:43:25 user nova-compute[71711]: No targets found.
Apr 12 06:43:25 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:43:25 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:43:25 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[295e7d36-65c7-4bd2-9bec-8773e859e2dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f267cbe-1d92-4ec2-8243-d359bd756132]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:43:25 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:43:25 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:43:25 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:43:25 user nova-compute[71711]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 (non-flash)
Apr 12 06:43:25 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:43:25 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995427f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31'): ({'sdd'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Removing single pathed devices sdd {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcee1324-f5d1-462e-883e-c74dd48a56b1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b134c3-7147-43b1-9849-c959d12fa647]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flushing IO for device /dev/sdd {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e4877e-e636-4d2b-84d2-ae05ec677d89]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac72f12-bc90-45c0-9a13-224fdb5fe95b]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_18441741', '/dev/disk/by-id/scsi-1SCST_BIO18441741-496962072efa8e48', '/dev/disk/by-id/scsi-23439363936323037') {{(pid=81777) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 06:43:25 user nova-compute[71711]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_18441741
Apr 12 06:43:25 user nova-compute[71711]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO18441741-496962072efa8e48
Apr 12 06:43:25 user nova-compute[71711]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23439363936323037
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fcec75-9ba3-473c-8ced-53ff0ecada56]: (4, None) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[01944050-ed00-4b11-8312-fcfb7863fed2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[03836034-4922-4578-843e-e35224ea10e2]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31, portal: 172.16.0.220,3260]
Apr 12 06:43:25 user nova-compute[71711]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31, portal: 172.16.0.220,3260] successful.
Apr 12 06:43:25 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b12a713-8214-4892-a05d-c4ae96583b31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[446e74d2-9e6c-41b0-bb6f-e65e9397e5c8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] <== disconnect_volume: return (349ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:43:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:43:25 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Deleting instance files /opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112_del
Apr 12 06:43:25 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Deletion of /opt/stack/data/nova/instances/207359ea-0c81-46aa-a638-276957be0112_del complete
Apr 12 06:43:26 user nova-compute[71711]: INFO nova.compute.manager [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Took 1.28 seconds to destroy the instance on the hypervisor.
Apr 12 06:43:26 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:43:26 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 207359ea-0c81-46aa-a638-276957be0112] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:43:26 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 207359ea-0c81-46aa-a638-276957be0112] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:43:26 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 207359ea-0c81-46aa-a638-276957be0112] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:43:26 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 207359ea-0c81-46aa-a638-276957be0112] Took 0.47 seconds to deallocate network for instance.
Apr 12 06:43:26 user nova-compute[71711]: DEBUG nova.compute.manager [req-32174ded-0d56-4e1a-b0e3-d32d7538fbae req-c827e425-20d9-478f-99d0-56cd05d969dd service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-deleted-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:27 user nova-compute[71711]: INFO nova.compute.manager [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Terminating instance
Apr 12 06:43:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-6dd3330a-4414-42da-bc81-808c7adf36e5 req-eb52f4d3-2b2b-457d-b526-b3937fa6fde8 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6dd3330a-4414-42da-bc81-808c7adf36e5 req-eb52f4d3-2b2b-457d-b526-b3937fa6fde8 service nova] Acquiring lock "207359ea-0c81-46aa-a638-276957be0112-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6dd3330a-4414-42da-bc81-808c7adf36e5 req-eb52f4d3-2b2b-457d-b526-b3937fa6fde8 service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6dd3330a-4414-42da-bc81-808c7adf36e5 req-eb52f4d3-2b2b-457d-b526-b3937fa6fde8 service nova] Lock "207359ea-0c81-46aa-a638-276957be0112-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-6dd3330a-4414-42da-bc81-808c7adf36e5 req-eb52f4d3-2b2b-457d-b526-b3937fa6fde8 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] No waiting events found dispatching network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:43:27 user nova-compute[71711]: WARNING nova.compute.manager [req-6dd3330a-4414-42da-bc81-808c7adf36e5 req-eb52f4d3-2b2b-457d-b526-b3937fa6fde8 service nova] [instance: 207359ea-0c81-46aa-a638-276957be0112] Received unexpected event network-vif-plugged-b9933569-0e24-4acb-b85d-ccb1eb9c5721 for instance with vm_state active and task_state deleting.
Apr 12 06:43:27 user nova-compute[71711]: INFO nova.compute.manager [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 207359ea-0c81-46aa-a638-276957be0112] Took 0.88 seconds to detach 1 volumes for instance.
Apr 12 06:43:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:27 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Instance destroyed successfully.
Apr 12 06:43:27 user nova-compute[71711]: DEBUG nova.objects.instance [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'resources' on Instance uuid 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1904973034',display_name='tempest-ServerRescueNegativeTestJSON-server-1904973034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1904973034',id=30,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVAhwxqVzIlu1Y1+woDzJhr+Sp8DkcWAIkNC1v3bFuM/UHwoGWA8kCbJpxtB+g0Vd0L70GVRFQK6LQHpxQxlm74MgcB1oB68hiKHRg3Ayp2r2eMMg/8ksw6i7RnCnnzag==',key_name='tempest-keypair-4832485',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:38:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='972842dc32ee4687866dfe2fbefe9cb4',ramdisk_id='',reservation_id='r-k8e58f3c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1179647693',owner_user_name='tempest-ServerRescueNegativeTestJSON-1179647693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:40:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc8e6af1db834409a4880040a5ef6a5a',uuid=8bd6a08b-ef82-4019-b5d3-7e84cb241eb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converting VIF {"id": "4d362992-cbb4-4530-b971-86688508274f", "address": "fa:16:3e:18:04:93", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d362992-cb", "ovs_interfaceid": "4d362992-cbb4-4530-b971-86688508274f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:04:93,bridge_name='br-int',has_traffic_filtering=True,id=4d362992-cbb4-4530-b971-86688508274f,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d362992-cb') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG os_vif [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:04:93,bridge_name='br-int',has_traffic_filtering=True,id=4d362992-cbb4-4530-b971-86688508274f,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d362992-cb') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:43:27 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Deleted allocations for instance 207359ea-0c81-46aa-a638-276957be0112
Apr 12 06:43:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d362992-cb, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:27 user nova-compute[71711]: INFO os_vif [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:04:93,bridge_name='br-int',has_traffic_filtering=True,id=4d362992-cbb4-4530-b971-86688508274f,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d362992-cb')
Apr 12 06:43:27 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Deleting instance files /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9_del
Apr 12 06:43:27 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Deletion of /opt/stack/data/nova/instances/8bd6a08b-ef82-4019-b5d3-7e84cb241eb9_del complete
Apr 12 06:43:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f558e005-afe2-4581-8975-3a60b1220260 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "207359ea-0c81-46aa-a638-276957be0112" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.206s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:27 user nova-compute[71711]: INFO nova.compute.manager [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 06:43:27 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:43:27 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:43:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-unplugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:43:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] No waiting events found dispatching network-vif-unplugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:43:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-unplugged-4d362992-cbb4-4530-b971-86688508274f for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:43:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:43:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] Acquiring lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] No waiting events found dispatching network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:43:28 user nova-compute[71711]: WARNING nova.compute.manager [req-714a19d5-b95f-46fe-9a3a-7dc4ee7fe0f4 req-9513563e-f63c-4ec7-b47c-612b8a6dcae9 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received unexpected event network-vif-plugged-4d362992-cbb4-4530-b971-86688508274f for instance with vm_state active and task_state deleting.
Apr 12 06:43:28 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:43:28 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Took 0.77 seconds to deallocate network for instance.
Apr 12 06:43:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:29 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:43:29 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:43:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:29 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Deleted allocations for instance 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9
Apr 12 06:43:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5c0fe494-cfc8-4c28-9583-c653519ceba3 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "8bd6a08b-ef82-4019-b5d3-7e84cb241eb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.148s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Received event network-changed-83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:43:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Refreshing instance network info cache due to event network-changed-83ad8682-5a06-482a-969b-965968a4a243. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:43:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] Acquiring lock "refresh_cache-c6bc228c-8c66-45e3-9140-1dd5d321b2c8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:43:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] Acquired lock "refresh_cache-c6bc228c-8c66-45e3-9140-1dd5d321b2c8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:43:29 user nova-compute[71711]: DEBUG nova.network.neutron [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Refreshing network info cache for port 83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:43:29 user nova-compute[71711]: DEBUG nova.network.neutron [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Updated VIF entry in instance network info cache for port 83ad8682-5a06-482a-969b-965968a4a243. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:43:29 user nova-compute[71711]: DEBUG nova.network.neutron [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Updating instance_info_cache with network_info: [{"id": "83ad8682-5a06-482a-969b-965968a4a243", "address": "fa:16:3e:3a:d2:7a", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ad8682-5a", "ovs_interfaceid": "83ad8682-5a06-482a-969b-965968a4a243", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:43:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-84afe5ab-6fbe-40c1-8cf6-46cf2de4bb0a req-fb4cbd5f-d7af-4ffc-988a-1886bceb7add service nova] Releasing lock "refresh_cache-c6bc228c-8c66-45e3-9140-1dd5d321b2c8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:43:30 user nova-compute[71711]: DEBUG nova.compute.manager [req-4776b021-60bc-4fcc-b02e-d69e88e6c107 req-a805edb9-dcfe-4931-89d3-014661422ce4 service nova] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Received event network-vif-deleted-4d362992-cbb4-4530-b971-86688508274f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:43:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:30 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'flavor' on Instance uuid c6bc228c-8c66-45e3-9140-1dd5d321b2c8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:43:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:31 user nova-compute[71711]: INFO nova.compute.manager [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Attaching volume 19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 to /dev/vdb
Apr 12 06:43:31 user nova-compute[71711]: DEBUG os_brick.utils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[782ce455-a812-4c88-8909-dc24b43c7963]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f36fe5-160a-4ecd-acaa-2004db262515]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74aba7e-8d5b-4408-818d-696c62444405]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ff3212-7d77-4ed4-9b36-e53abb8f8fc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:43:31 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:43:31 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e67195-0447-4715-a857-24acda97399a]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG os_brick.utils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:43:31 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Updating existing volume attachment record: 8e1742a1-38bf-477b-aed3-cb2bde050367 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:43:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQlRDGcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:43:35 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:43:35 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:43:35 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aef1814-f296-4467-88b3-81886ec6df8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:43:35 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c811db5-4369-41fd-b107-b01f921fb1d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0] added
Apr 12 06:43:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.104s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8cca3b-0c9d-4715-a04f-5f0d8862b273]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4d38ec-3f5e-412b-b504-0307cb3e8e7b]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQlRDGcx {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQlRDGcx" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[801904c9-475a-437c-83a2-77aa41ca25a2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yQlRDGcx'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[87114929-e08f-4a49-a321-dec46f20b7fb]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31901d6-56d4-41d6-a55b-a5c23a0163ab]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:43:35 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:43:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:43:35 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:43:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ea2eac-b6dc-4041-a4d8-7d681cff80e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0, portal: 172.16.0.220,3260]
Apr 12 06:43:35 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0, portal: 172.16.0.220,3260] successful.
Apr 12 06:43:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cbadcf-75fd-406d-be23-1e1089bd1f81]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d381af96-f8cb-4c28-a3e5-23e18a27f973]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:43:35 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:43:35 user nova-compute[71711]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 (non-flash)
Apr 12 06:43:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:43:35 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:43:35 user nova-compute[71711]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 (non-flash)
Apr 12 06:43:35 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d374268d-34df-4f86-9928-69ee137ff3db]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:35 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:43:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:43:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQlRDGcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:43:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:43:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26663616630616164', 'path': '/dev/sdd'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:43:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663616630616164', 'path': '/dev/sdd'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:43:36 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'flavor' on Instance uuid c6bc228c-8c66-45e3-9140-1dd5d321b2c8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:43:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:43:36 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:43:36 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:43:36 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:43:36 user nova-compute[71711]:   <serial>19ab1977-9c7a-4434-8e2c-2b9b0899eeb0</serial>
Apr 12 06:43:36 user nova-compute[71711]: </disk>
Apr 12 06:43:36 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:43:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:43:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:43:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] No VIF found with MAC fa:16:3e:3a:d2:7a, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:43:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1d84ec43-4f15-49d2-aeb2-199c6a8e61e0 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.363s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:43:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:43:37 user nova-compute[71711]: INFO nova.compute.manager [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Detaching volume 19ab1977-9c7a-4434-8e2c-2b9b0899eeb0
Apr 12 06:43:38 user nova-compute[71711]: INFO nova.virt.block_device [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Attempting to driver detach volume 19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 from mountpoint /dev/vdb
Apr 12 06:43:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Attempting to detach device vdb from instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:43:38 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:43:38 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:43:38 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:43:38 user nova-compute[71711]:   <serial>19ab1977-9c7a-4434-8e2c-2b9b0899eeb0</serial>
Apr 12 06:43:38 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:43:38 user nova-compute[71711]: </disk>
Apr 12 06:43:38 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:43:38 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully detached device vdb from instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 from the persistent domain config.
Apr 12 06:43:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:43:38 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:43:38 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:43:38 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:43:38 user nova-compute[71711]:   <serial>19ab1977-9c7a-4434-8e2c-2b9b0899eeb0</serial>
Apr 12 06:43:38 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:43:38 user nova-compute[71711]: </disk>
Apr 12 06:43:38 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681281818.5219586, c6bc228c-8c66-45e3-9140-1dd5d321b2c8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:43:38 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully detached device vdb from instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 from the live domain config.
Apr 12 06:43:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQlRDGcx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:43:38 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cc04dd-ae16-44da-a535-e3c976b71a39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:43:38 user nova-compute[71711]: No targets found.
Apr 12 06:43:38 user nova-compute[71711]: iSNS:
Apr 12 06:43:38 user nova-compute[71711]: No targets found.
Apr 12 06:43:38 user nova-compute[71711]: STATIC:
Apr 12 06:43:38 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0
Apr 12 06:43:38 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:43:38 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:43:38 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7
Apr 12 06:43:38 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:43:38 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:43:38 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:43:38 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:43:38 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:43:38 user nova-compute[71711]: FIRMWARE:
Apr 12 06:43:38 user nova-compute[71711]: No targets found.
Apr 12 06:43:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:43:38 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:43:38 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ecbaed-8955-44d7-bfd1-97f2e843ee36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[118a17b6-d72c-4488-9cf5-7819ca629d34]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:43:38 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:43:38 user nova-compute[71711]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 (non-flash)
Apr 12 06:43:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:43:38 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:43:38 user nova-compute[71711]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 (non-flash)
Apr 12 06:43:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995ecab0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0'): ({'sdd'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Removing single pathed devices sdd {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce54549b-b14a-4dfc-a693-1e6d7960a75a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0518958-faa1-492f-8655-fdab620b3686]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Flushing IO for device /dev/sdd {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff9520f-a4d3-4746-8d8c-959b58fb7556]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a34b175-2309-4d9f-a8a6-05a9d7c4ab4d]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[225d0929-f46b-4080-b2e6-fbfc116e587a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85edce6-d2c6-4190-8621-2e343210788b]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0, portal: 172.16.0.220,3260]
Apr 12 06:43:38 user nova-compute[71711]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0, portal: 172.16.0.220,3260] successful.
Apr 12 06:43:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19ab1977-9c7a-4434-8e2c-2b9b0899eeb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd6997c-6b83-4c05-a5aa-116f3b7c0348]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] <== disconnect_volume: return (306ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:43:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:43:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:39 user nova-compute[71711]: DEBUG nova.objects.instance [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'flavor' on Instance uuid c6bc228c-8c66-45e3-9140-1dd5d321b2c8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:43:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-42448c89-deb2-4e89-80c9-11719848183f tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.672s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:43:40 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281805.5854552, 207359ea-0c81-46aa-a638-276957be0112 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:43:40 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 207359ea-0c81-46aa-a638-276957be0112] VM Stopped (Lifecycle Event)
Apr 12 06:43:40 user nova-compute[71711]: DEBUG nova.compute.manager [None req-06e9ba29-6f00-4423-bce8-13ece6484c4e None None] [instance: 207359ea-0c81-46aa-a638-276957be0112] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:43:42 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281807.8847158, 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:43:42 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] VM Stopped (Lifecycle Event)
Apr 12 06:43:42 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5c323f7d-f38f-43f7-8197-de45c2492b00 None None] [instance: 8bd6a08b-ef82-4019-b5d3-7e84cb241eb9] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:43:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:43 user nova-compute[71711]: INFO nova.compute.manager [None req-36cec60d-2459-4fa3-9055-53512b20b706 tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Get console output
Apr 12 06:43:43 user nova-compute[71711]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 12 06:43:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:52 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:43:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:43:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:43:58 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:43:58 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:43:58 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:44:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:44:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:44:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:04 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:44:04 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8115MB free_disk=26.023395538330078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'flavor' on Instance uuid bbb5bae3-4c69-429d-b71c-8dee3437aff8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:44:04 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Ignoring supplied device name: /dev/vdb
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c64aff93-15fa-4520-b6ac-cdcacb49478e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance faa2ad52-9528-4013-ad20-4a1d636aed14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 51402ffe-ef35-41a3-811b-5a00788a13d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:04 user nova-compute[71711]: INFO nova.compute.manager [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Attaching volume 9004e518-c5eb-40fa-8afd-932d1d8b1625 to /dev/vdb
Apr 12 06:44:04 user nova-compute[71711]: DEBUG os_brick.utils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e33442-4bed-4de5-9508-3e7ec4e38058]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeae619-1d84-4e63-b3c4-7bc9e0110f26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dd6b78-e6f1-45a9-a426-f2dddf81f453]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafeafa5-2a10-4a98-989e-9b2d18b9c121]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:44:04 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[625c0c3c-e4bd-4ed6-bb2d-e0d86a7ff95f]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG os_brick.utils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Updating existing volume attachment record: 132c38c7-5faf-4035-8b8c-c5116ac6074e {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:44:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:44:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:44:07 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:44:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJSKYpdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:44:08 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:44:08 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:44:08 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[caff2a66-2d8e-498e-bf82-f46e9efc1891]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:44:08 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a304c5-fad0-4f3f-8d44-5c0c265ea79c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625] added
Apr 12 06:44:08 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09e746f-f546-4eb4-b301-cdbd357ef74d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca0787b-bb3c-4f73-a29d-d73fa94bd5a5]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJSKYpdN {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJSKYpdN" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c8a76f-150f-449a-b5cd-75ef711f7fb7]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yJSKYpdN'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4dd8db-2d0c-4eeb-b1c7-38415111fba1]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a763d7-7d14-4c6d-aba6-ad63beaeb5f4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:44:08 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:44:08 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:44:08 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:44:08 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3853a9-8d27-4fab-b2e8-87d7a8678eaf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625, portal: 172.16.0.220,3260]
Apr 12 06:44:08 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625, portal: 172.16.0.220,3260] successful.
Apr 12 06:44:08 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd09443c-b726-486a-9fe6-30b7453957fd]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d235ae57-d937-4e9e-82e9-811411905480]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:44:08 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:44:08 user nova-compute[71711]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 (non-flash)
Apr 12 06:44:08 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:44:08 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:44:08 user nova-compute[71711]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 (non-flash)
Apr 12 06:44:08 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[887971a4-dc5e-4373-8993-c056837f6c86]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:44:08 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJSKYpdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:44:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:44:09 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23431336366616332', 'path': '/dev/sdd'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:44:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431336366616332', 'path': '/dev/sdd'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:44:09 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'flavor' on Instance uuid bbb5bae3-4c69-429d-b71c-8dee3437aff8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:44:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:44:09 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:44:09 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:44:09 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:44:09 user nova-compute[71711]:   <serial>9004e518-c5eb-40fa-8afd-932d1d8b1625</serial>
Apr 12 06:44:09 user nova-compute[71711]: </disk>
Apr 12 06:44:09 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:44:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:44:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:44:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] No VIF found with MAC fa:16:3e:a5:67:ba, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:44:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e7295922-9023-4fdd-b976-2c67a4453664 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.172s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:44:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:44:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:44:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:44:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "faa2ad52-9528-4013-ad20-4a1d636aed14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:15 user nova-compute[71711]: INFO nova.compute.manager [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Terminating instance
Apr 12 06:44:15 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-82d350b3-1ebd-464d-a800-2d11862eb95d req-0334fce4-1be5-406a-9907-66fa30fa5ed6 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received event network-vif-unplugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-82d350b3-1ebd-464d-a800-2d11862eb95d req-0334fce4-1be5-406a-9907-66fa30fa5ed6 service nova] Acquiring lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-82d350b3-1ebd-464d-a800-2d11862eb95d req-0334fce4-1be5-406a-9907-66fa30fa5ed6 service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-82d350b3-1ebd-464d-a800-2d11862eb95d req-0334fce4-1be5-406a-9907-66fa30fa5ed6 service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-82d350b3-1ebd-464d-a800-2d11862eb95d req-0334fce4-1be5-406a-9907-66fa30fa5ed6 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] No waiting events found dispatching network-vif-unplugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-82d350b3-1ebd-464d-a800-2d11862eb95d req-0334fce4-1be5-406a-9907-66fa30fa5ed6 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received event network-vif-unplugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:16 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Instance destroyed successfully.
Apr 12 06:44:16 user nova-compute[71711]: DEBUG nova.objects.instance [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'resources' on Instance uuid faa2ad52-9528-4013-ad20-4a1d636aed14 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1846086682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1846086682',id=28,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:35:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-oy53gvy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:36:50Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=faa2ad52-9528-4013-ad20-4a1d636aed14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "address": "fa:16:3e:d7:dc:4b", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07855ce5-96", "ovs_interfaceid": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "address": "fa:16:3e:d7:dc:4b", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07855ce5-96", "ovs_interfaceid": "07855ce5-9604-4b55-86e2-1c4dfe89d70f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=07855ce5-9604-4b55-86e2-1c4dfe89d70f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07855ce5-96') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG os_vif [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=07855ce5-9604-4b55-86e2-1c4dfe89d70f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07855ce5-96') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07855ce5-96, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:44:16 user nova-compute[71711]: INFO os_vif [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:dc:4b,bridge_name='br-int',has_traffic_filtering=True,id=07855ce5-9604-4b55-86e2-1c4dfe89d70f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07855ce5-96')
Apr 12 06:44:16 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Deleting instance files /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14_del
Apr 12 06:44:16 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Deletion of /opt/stack/data/nova/instances/faa2ad52-9528-4013-ad20-4a1d636aed14_del complete
Apr 12 06:44:16 user nova-compute[71711]: INFO nova.compute.manager [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 06:44:16 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:16 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:44:16 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Took 0.54 seconds to deallocate network for instance.
Apr 12 06:44:16 user nova-compute[71711]: DEBUG nova.compute.manager [req-1927a832-017b-45c3-bb7a-4477b16f50ab req-3d0809ea-b2af-4188-85e6-7ecac6d683c7 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received event network-vif-deleted-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:17 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Deleted allocations for instance faa2ad52-9528-4013-ad20-4a1d636aed14
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4db79423-764e-4186-a506-65c6cf1f36ee tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.986s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received event network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Acquiring lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] No waiting events found dispatching network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:44:17 user nova-compute[71711]: WARNING nova.compute.manager [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received unexpected event network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance with vm_state deleted and task_state None.
Apr 12 06:44:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received event network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Acquiring lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] No waiting events found dispatching network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:44:17 user nova-compute[71711]: WARNING nova.compute.manager [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received unexpected event network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance with vm_state deleted and task_state None.
Apr 12 06:44:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received event network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Acquiring lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] No waiting events found dispatching network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:44:17 user nova-compute[71711]: WARNING nova.compute.manager [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received unexpected event network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance with vm_state deleted and task_state None.
Apr 12 06:44:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received event network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Acquiring lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] Lock "faa2ad52-9528-4013-ad20-4a1d636aed14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] No waiting events found dispatching network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:44:17 user nova-compute[71711]: WARNING nova.compute.manager [req-e6d7d1c3-a64a-4cdc-a956-5d4fc9c64906 req-9f53ffd9-fcf3-4da6-ab7d-6f742c86ae34 service nova] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Received unexpected event network-vif-plugged-07855ce5-9604-4b55-86e2-1c4dfe89d70f for instance with vm_state deleted and task_state None.
Apr 12 06:44:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "c64aff93-15fa-4520-b6ac-cdcacb49478e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:22 user nova-compute[71711]: INFO nova.compute.manager [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Terminating instance
Apr 12 06:44:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:44:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:22 user nova-compute[71711]: DEBUG nova.compute.manager [req-f312c20e-89d6-46f9-94fb-04a7a75321cb req-5df50b7d-61df-42d4-a263-1b6422c93482 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received event network-vif-unplugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f312c20e-89d6-46f9-94fb-04a7a75321cb req-5df50b7d-61df-42d4-a263-1b6422c93482 service nova] Acquiring lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f312c20e-89d6-46f9-94fb-04a7a75321cb req-5df50b7d-61df-42d4-a263-1b6422c93482 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f312c20e-89d6-46f9-94fb-04a7a75321cb req-5df50b7d-61df-42d4-a263-1b6422c93482 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:22 user nova-compute[71711]: DEBUG nova.compute.manager [req-f312c20e-89d6-46f9-94fb-04a7a75321cb req-5df50b7d-61df-42d4-a263-1b6422c93482 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] No waiting events found dispatching network-vif-unplugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:44:22 user nova-compute[71711]: DEBUG nova.compute.manager [req-f312c20e-89d6-46f9-94fb-04a7a75321cb req-5df50b7d-61df-42d4-a263-1b6422c93482 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received event network-vif-unplugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:44:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:23 user nova-compute[71711]: INFO nova.compute.manager [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Detaching volume 9004e518-c5eb-40fa-8afd-932d1d8b1625
Apr 12 06:44:23 user nova-compute[71711]: INFO nova.virt.block_device [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Attempting to driver detach volume 9004e518-c5eb-40fa-8afd-932d1d8b1625 from mountpoint /dev/vdb
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Attempting to detach device vdb from instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:44:23 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:44:23 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:44:23 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:44:23 user nova-compute[71711]:   <serial>9004e518-c5eb-40fa-8afd-932d1d8b1625</serial>
Apr 12 06:44:23 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:44:23 user nova-compute[71711]: </disk>
Apr 12 06:44:23 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:44:23 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Successfully detached device vdb from instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 from the persistent domain config.
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:44:23 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:44:23 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:44:23 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:44:23 user nova-compute[71711]:   <serial>9004e518-c5eb-40fa-8afd-932d1d8b1625</serial>
Apr 12 06:44:23 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:44:23 user nova-compute[71711]: </disk>
Apr 12 06:44:23 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681281863.63701, bbb5bae3-4c69-429d-b71c-8dee3437aff8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:44:23 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Successfully detached device vdb from instance bbb5bae3-4c69-429d-b71c-8dee3437aff8 from the live domain config.
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJSKYpdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:44:23 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:23 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Instance destroyed successfully.
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.objects.instance [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'resources' on Instance uuid c64aff93-15fa-4520-b6ac-cdcacb49478e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:28:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-335972391',display_name='tempest-ServerRescueNegativeTestJSON-server-335972391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-335972391',id=18,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:30:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='972842dc32ee4687866dfe2fbefe9cb4',ramdisk_id='',reservation_id='r-dv6aie1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1179647693',owner_user_name='tempest-ServerRescueNegativeTestJSON-1179647693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:30:23Z,user_data=None,user_id='dc8e6af1db834409a4880040a5ef6a5a',uuid=c64aff93-15fa-4520-b6ac-cdcacb49478e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converting VIF {"id": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "address": "fa:16:3e:92:30:50", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6649e98a-d7", "ovs_interfaceid": "6649e98a-d7bc-4e7a-ab8b-d00622606a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:30:50,bridge_name='br-int',has_traffic_filtering=True,id=6649e98a-d7bc-4e7a-ab8b-d00622606a3b,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6649e98a-d7') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_vif [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:30:50,bridge_name='br-int',has_traffic_filtering=True,id=6649e98a-d7bc-4e7a-ab8b-d00622606a3b,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6649e98a-d7') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b97a7c-a97d-435a-99a8-66fd8e6ead3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:44:23 user nova-compute[71711]: No targets found.
Apr 12 06:44:23 user nova-compute[71711]: iSNS:
Apr 12 06:44:23 user nova-compute[71711]: No targets found.
Apr 12 06:44:23 user nova-compute[71711]: STATIC:
Apr 12 06:44:23 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7
Apr 12 06:44:23 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:44:23 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:44:23 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625
Apr 12 06:44:23 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:44:23 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:44:23 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:44:23 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:44:23 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:44:23 user nova-compute[71711]: FIRMWARE:
Apr 12 06:44:23 user nova-compute[71711]: No targets found.
Apr 12 06:44:23 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:44:23 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:44:23 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6649e98a-d7, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:44:23 user nova-compute[71711]: INFO os_vif [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:30:50,bridge_name='br-int',has_traffic_filtering=True,id=6649e98a-d7bc-4e7a-ab8b-d00622606a3b,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6649e98a-d7')
Apr 12 06:44:23 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Deleting instance files /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e_del
Apr 12 06:44:23 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Deletion of /opt/stack/data/nova/instances/c64aff93-15fa-4520-b6ac-cdcacb49478e_del complete
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7359fe79-91da-4ccb-ba5c-492106ab5555]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f573d6f-2fe7-495c-b6d3-84b3bfaa9fbe]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:44:23 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:44:23 user nova-compute[71711]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 (non-flash)
Apr 12 06:44:23 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:44:23 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:44:23 user nova-compute[71711]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 (non-flash)
Apr 12 06:44:23 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c368280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625'): ({'sdd'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Removing single pathed devices sdd {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:23 user nova-compute[71711]: INFO nova.compute.manager [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24fc5f0-339f-47e6-ae66-1785e5666d9e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe74668a-aac6-4779-a769-9d9545844d67]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Flushing IO for device /dev/sdd {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[99293af2-cd50-44b7-81c5-2f360be3d0cb]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e42e124-9744-427b-a456-3127dd4178f2]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[16849399-5db5-4d53-b262-ea373347abc2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6a4325-200d-4677-aacf-9ce4e489d7c5]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625, portal: 172.16.0.220,3260]
Apr 12 06:44:23 user nova-compute[71711]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625, portal: 172.16.0.220,3260] successful.
Apr 12 06:44:23 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4912e3fd-6138-4f13-beb7-99abc8c084d2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] <== disconnect_volume: return (338ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:44:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:44:24 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:44:24 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Took 0.69 seconds to deallocate network for instance.
Apr 12 06:44:24 user nova-compute[71711]: DEBUG nova.compute.manager [req-c7a62b74-cad6-47cd-a251-81767e20a6a8 req-021053e2-c6a2-45f0-b3c0-eefd5550db90 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received event network-vif-deleted-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:24 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:44:24 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:44:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:24 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Deleted allocations for instance c64aff93-15fa-4520-b6ac-cdcacb49478e
Apr 12 06:44:24 user nova-compute[71711]: DEBUG nova.objects.instance [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'flavor' on Instance uuid bbb5bae3-4c69-429d-b71c-8dee3437aff8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:44:24 user nova-compute[71711]: DEBUG nova.compute.manager [req-b807a361-b4a1-4c2e-9414-60540e056e9d req-58d4e504-878e-42f0-ba13-ec1851e88638 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received event network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b807a361-b4a1-4c2e-9414-60540e056e9d req-58d4e504-878e-42f0-ba13-ec1851e88638 service nova] Acquiring lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b807a361-b4a1-4c2e-9414-60540e056e9d req-58d4e504-878e-42f0-ba13-ec1851e88638 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b807a361-b4a1-4c2e-9414-60540e056e9d req-58d4e504-878e-42f0-ba13-ec1851e88638 service nova] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:24 user nova-compute[71711]: DEBUG nova.compute.manager [req-b807a361-b4a1-4c2e-9414-60540e056e9d req-58d4e504-878e-42f0-ba13-ec1851e88638 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] No waiting events found dispatching network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:44:24 user nova-compute[71711]: WARNING nova.compute.manager [req-b807a361-b4a1-4c2e-9414-60540e056e9d req-58d4e504-878e-42f0-ba13-ec1851e88638 service nova] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Received unexpected event network-vif-plugged-6649e98a-d7bc-4e7a-ab8b-d00622606a3b for instance with vm_state deleted and task_state None.
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f60f7268-c51a-4073-9559-ee5d57b07b54 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.883s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.758s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:25 user nova-compute[71711]: INFO nova.compute.manager [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Terminating instance
Apr 12 06:44:25 user nova-compute[71711]: DEBUG nova.compute.manager [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a3786e4-107f-472b-afa5-fb8441631eb0 tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "c64aff93-15fa-4520-b6ac-cdcacb49478e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.458s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee589631-bc92-4631-8936-07d1148f3b1c req-de87692a-951c-49b4-a256-8901a29a9c6d service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Received event network-vif-unplugged-8cec16af-061e-4a14-bf55-f33bd17192e7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee589631-bc92-4631-8936-07d1148f3b1c req-de87692a-951c-49b4-a256-8901a29a9c6d service nova] Acquiring lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee589631-bc92-4631-8936-07d1148f3b1c req-de87692a-951c-49b4-a256-8901a29a9c6d service nova] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ee589631-bc92-4631-8936-07d1148f3b1c req-de87692a-951c-49b4-a256-8901a29a9c6d service nova] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee589631-bc92-4631-8936-07d1148f3b1c req-de87692a-951c-49b4-a256-8901a29a9c6d service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] No waiting events found dispatching network-vif-unplugged-8cec16af-061e-4a14-bf55-f33bd17192e7 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-ee589631-bc92-4631-8936-07d1148f3b1c req-de87692a-951c-49b4-a256-8901a29a9c6d service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Received event network-vif-unplugged-8cec16af-061e-4a14-bf55-f33bd17192e7 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:44:25 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Instance destroyed successfully.
Apr 12 06:44:25 user nova-compute[71711]: DEBUG nova.objects.instance [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'resources' on Instance uuid bbb5bae3-4c69-429d-b71c-8dee3437aff8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-69068700',display_name='tempest-VolumesSnapshotTestJSON-instance-69068700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-69068700',id=35,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:42:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af34529636fc4221921028f93b1c381a',ramdisk_id='',reservation_id='r-jjjyze9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2015355536',owner_user_name='tempest-VolumesSnapshotTestJSON-2015355536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:42:20Z,user_data=None,user_id='8546fd1ed08b4e88a945e73347be38c2',uuid=bbb5bae3-4c69-429d-b71c-8dee3437aff8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cec16af-061e-4a14-bf55-f33bd17192e7", "address": "fa:16:3e:a5:67:ba", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cec16af-06", "ovs_interfaceid": "8cec16af-061e-4a14-bf55-f33bd17192e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Converting VIF {"id": "8cec16af-061e-4a14-bf55-f33bd17192e7", "address": "fa:16:3e:a5:67:ba", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cec16af-06", "ovs_interfaceid": "8cec16af-061e-4a14-bf55-f33bd17192e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:67:ba,bridge_name='br-int',has_traffic_filtering=True,id=8cec16af-061e-4a14-bf55-f33bd17192e7,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cec16af-06') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG os_vif [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:67:ba,bridge_name='br-int',has_traffic_filtering=True,id=8cec16af-061e-4a14-bf55-f33bd17192e7,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cec16af-06') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cec16af-06, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:44:25 user nova-compute[71711]: INFO os_vif [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:67:ba,bridge_name='br-int',has_traffic_filtering=True,id=8cec16af-061e-4a14-bf55-f33bd17192e7,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cec16af-06')
Apr 12 06:44:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJSKYpdN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:44:25 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:44:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e248d38-3076-4e16-975b-692895124b55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:44:25 user nova-compute[71711]: No targets found.
Apr 12 06:44:25 user nova-compute[71711]: iSNS:
Apr 12 06:44:25 user nova-compute[71711]: No targets found.
Apr 12 06:44:25 user nova-compute[71711]: STATIC:
Apr 12 06:44:25 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7
Apr 12 06:44:25 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:44:25 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:44:25 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:44:25 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:44:25 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:44:25 user nova-compute[71711]: FIRMWARE:
Apr 12 06:44:25 user nova-compute[71711]: No targets found.
Apr 12 06:44:25 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:44:25 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:44:25 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9004e518-c5eb-40fa-8afd-932d1d8b1625', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f86aa6d-6d05-4524-bd0b-2c0c7755bf16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0061b0b-41d0-4c17-9d67-330af1c9a2d6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:44:25 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:44:25 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:44:25 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:44:25 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c1bb520>, {}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Disconnecting from: [] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] <== disconnect_volume: return (73ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:44:25 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Deleting instance files /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8_del
Apr 12 06:44:25 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Deletion of /opt/stack/data/nova/instances/bbb5bae3-4c69-429d-b71c-8dee3437aff8_del complete
Apr 12 06:44:25 user nova-compute[71711]: INFO nova.compute.manager [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 12 06:44:25 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:44:25 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:44:26 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:44:26 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Took 0.45 seconds to deallocate network for instance.
Apr 12 06:44:26 user nova-compute[71711]: WARNING nova.volume.cinder [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Attachment 132c38c7-5faf-4035-8b8c-c5116ac6074e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 132c38c7-5faf-4035-8b8c-c5116ac6074e. (HTTP 404) (Request-ID: req-b2762590-2884-4898-b9d1-e5db0f7a3fb9)
Apr 12 06:44:26 user nova-compute[71711]: INFO nova.compute.manager [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Took 0.03 seconds to detach 1 volumes for instance.
Apr 12 06:44:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:26 user nova-compute[71711]: DEBUG nova.compute.manager [req-f36cb2aa-f2be-428e-ae5d-df36b8f5c31b req-40efbfbb-bf34-4019-bf2d-5e09b73aac1e service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Received event network-vif-deleted-8cec16af-061e-4a14-bf55-f33bd17192e7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:26 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:44:26 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:44:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:26 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Deleted allocations for instance bbb5bae3-4c69-429d-b71c-8dee3437aff8
Apr 12 06:44:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c79e16f-0a9a-414a-a688-0f05fff6cbde tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.886s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-a58a40f2-aeed-40bf-8f81-6ede713d276b req-de10f445-345b-4153-a1ed-0956a0b8f940 service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Received event network-vif-plugged-8cec16af-061e-4a14-bf55-f33bd17192e7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a58a40f2-aeed-40bf-8f81-6ede713d276b req-de10f445-345b-4153-a1ed-0956a0b8f940 service nova] Acquiring lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a58a40f2-aeed-40bf-8f81-6ede713d276b req-de10f445-345b-4153-a1ed-0956a0b8f940 service nova] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a58a40f2-aeed-40bf-8f81-6ede713d276b req-de10f445-345b-4153-a1ed-0956a0b8f940 service nova] Lock "bbb5bae3-4c69-429d-b71c-8dee3437aff8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-a58a40f2-aeed-40bf-8f81-6ede713d276b req-de10f445-345b-4153-a1ed-0956a0b8f940 service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] No waiting events found dispatching network-vif-plugged-8cec16af-061e-4a14-bf55-f33bd17192e7 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:44:27 user nova-compute[71711]: WARNING nova.compute.manager [req-a58a40f2-aeed-40bf-8f81-6ede713d276b req-de10f445-345b-4153-a1ed-0956a0b8f940 service nova] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Received unexpected event network-vif-plugged-8cec16af-061e-4a14-bf55-f33bd17192e7 for instance with vm_state deleted and task_state None.
Apr 12 06:44:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:28 user nova-compute[71711]: INFO nova.compute.manager [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Terminating instance
Apr 12 06:44:28 user nova-compute[71711]: DEBUG nova.compute.manager [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:44:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-d765c580-1dee-4b20-809a-7c2bb209689a req-59d2ba59-2e65-4298-8568-997c2e36db92 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Received event network-vif-unplugged-83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d765c580-1dee-4b20-809a-7c2bb209689a req-59d2ba59-2e65-4298-8568-997c2e36db92 service nova] Acquiring lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d765c580-1dee-4b20-809a-7c2bb209689a req-59d2ba59-2e65-4298-8568-997c2e36db92 service nova] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-d765c580-1dee-4b20-809a-7c2bb209689a req-59d2ba59-2e65-4298-8568-997c2e36db92 service nova] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-d765c580-1dee-4b20-809a-7c2bb209689a req-59d2ba59-2e65-4298-8568-997c2e36db92 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] No waiting events found dispatching network-vif-unplugged-83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:44:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-d765c580-1dee-4b20-809a-7c2bb209689a req-59d2ba59-2e65-4298-8568-997c2e36db92 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Received event network-vif-unplugged-83ad8682-5a06-482a-969b-965968a4a243 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:44:29 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Instance destroyed successfully.
Apr 12 06:44:29 user nova-compute[71711]: DEBUG nova.objects.instance [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lazy-loading 'resources' on Instance uuid c6bc228c-8c66-45e3-9140-1dd5d321b2c8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:44:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:41:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-575862616',display_name='tempest-AttachVolumeNegativeTest-server-575862616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-575862616',id=34,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJovVVq9DlDt8OQJmv/ymM2orTxdeZEzo0KqhHfwyEqKcuzEEqG1eSncSTiiH+GPjR0VagPk4aBi/3x6BLntkCMzQHvNNCjXhV3C26xfCb1BqKX/0T8BZsCsPN0Rhy0ew==',key_name='tempest-keypair-1165194356',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:41:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b267dce1303d451ca307eeaa38baf685',ramdisk_id='',reservation_id='r-01rcqvnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1905486920',owner_user_name='tempest-AttachVolumeNegativeTest-1905486920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:41:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6cd1f8b3c0d42298f6f4a303f1251ec',uuid=c6bc228c-8c66-45e3-9140-1dd5d321b2c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83ad8682-5a06-482a-969b-965968a4a243", "address": "fa:16:3e:3a:d2:7a", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ad8682-5a", "ovs_interfaceid": "83ad8682-5a06-482a-969b-965968a4a243", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:44:29 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converting VIF {"id": "83ad8682-5a06-482a-969b-965968a4a243", "address": "fa:16:3e:3a:d2:7a", "network": {"id": "50460fb0-3b6e-4da6-890c-1777c1d64acc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1187628841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267dce1303d451ca307eeaa38baf685", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ad8682-5a", "ovs_interfaceid": "83ad8682-5a06-482a-969b-965968a4a243", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:44:29 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:d2:7a,bridge_name='br-int',has_traffic_filtering=True,id=83ad8682-5a06-482a-969b-965968a4a243,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ad8682-5a') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:44:29 user nova-compute[71711]: DEBUG os_vif [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:d2:7a,bridge_name='br-int',has_traffic_filtering=True,id=83ad8682-5a06-482a-969b-965968a4a243,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ad8682-5a') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:44:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83ad8682-5a, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:44:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:29 user nova-compute[71711]: INFO os_vif [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:d2:7a,bridge_name='br-int',has_traffic_filtering=True,id=83ad8682-5a06-482a-969b-965968a4a243,network=Network(50460fb0-3b6e-4da6-890c-1777c1d64acc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ad8682-5a')
Apr 12 06:44:29 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Deleting instance files /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8_del
Apr 12 06:44:29 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Deletion of /opt/stack/data/nova/instances/c6bc228c-8c66-45e3-9140-1dd5d321b2c8_del complete
Apr 12 06:44:29 user nova-compute[71711]: INFO nova.compute.manager [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 12 06:44:29 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:44:29 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:44:29 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:44:29 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:44:29 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Took 0.67 seconds to deallocate network for instance.
Apr 12 06:44:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:30 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:44:30 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:44:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:30 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Deleted allocations for instance c6bc228c-8c66-45e3-9140-1dd5d321b2c8
Apr 12 06:44:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-545e8961-16c9-4822-b939-46d6d2a54512 tempest-AttachVolumeNegativeTest-1905486920 tempest-AttachVolumeNegativeTest-1905486920-project-member] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.925s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:30 user nova-compute[71711]: DEBUG nova.compute.manager [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Received event network-vif-plugged-83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] Acquiring lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] Lock "c6bc228c-8c66-45e3-9140-1dd5d321b2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:30 user nova-compute[71711]: DEBUG nova.compute.manager [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] No waiting events found dispatching network-vif-plugged-83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:44:30 user nova-compute[71711]: WARNING nova.compute.manager [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Received unexpected event network-vif-plugged-83ad8682-5a06-482a-969b-965968a4a243 for instance with vm_state deleted and task_state None.
Apr 12 06:44:30 user nova-compute[71711]: DEBUG nova.compute.manager [req-14538f3a-a47f-47e6-bc19-175a15d72f02 req-ca30bee3-66fd-4a70-808d-adf5c1473e73 service nova] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Received event network-vif-deleted-83ad8682-5a06-482a-969b-965968a4a243 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:31 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281856.3280296, faa2ad52-9528-4013-ad20-4a1d636aed14 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:44:31 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] VM Stopped (Lifecycle Event)
Apr 12 06:44:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6bbfd1f5-ba86-4563-b10d-561e356c8239 None None] [instance: faa2ad52-9528-4013-ad20-4a1d636aed14] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:44:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:38 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281863.665623, c64aff93-15fa-4520-b6ac-cdcacb49478e => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:44:38 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] VM Stopped (Lifecycle Event)
Apr 12 06:44:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-888d4df0-b9fd-42ca-925a-3d1098549b4c None None] [instance: c64aff93-15fa-4520-b6ac-cdcacb49478e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:44:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:40 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281865.7825758, bbb5bae3-4c69-429d-b71c-8dee3437aff8 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:44:40 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] VM Stopped (Lifecycle Event)
Apr 12 06:44:40 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6543ef18-c37c-497b-84fb-b87c6380067d None None] [instance: bbb5bae3-4c69-429d-b71c-8dee3437aff8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:44:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:43 user nova-compute[71711]: INFO nova.compute.manager [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Terminating instance
Apr 12 06:44:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281869.063467, c6bc228c-8c66-45e3-9140-1dd5d321b2c8 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:44:44 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] VM Stopped (Lifecycle Event)
Apr 12 06:44:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a8aea055-f689-4e6f-aadb-6d0663874238 None None] [instance: c6bc228c-8c66-45e3-9140-1dd5d321b2c8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-1e8247e2-4ad0-4d0f-80c5-83a8fba30867 req-94b7af1f-3181-46bf-b1e8-3c32f82f6415 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received event network-vif-unplugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1e8247e2-4ad0-4d0f-80c5-83a8fba30867 req-94b7af1f-3181-46bf-b1e8-3c32f82f6415 service nova] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1e8247e2-4ad0-4d0f-80c5-83a8fba30867 req-94b7af1f-3181-46bf-b1e8-3c32f82f6415 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1e8247e2-4ad0-4d0f-80c5-83a8fba30867 req-94b7af1f-3181-46bf-b1e8-3c32f82f6415 service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-1e8247e2-4ad0-4d0f-80c5-83a8fba30867 req-94b7af1f-3181-46bf-b1e8-3c32f82f6415 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] No waiting events found dispatching network-vif-unplugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-1e8247e2-4ad0-4d0f-80c5-83a8fba30867 req-94b7af1f-3181-46bf-b1e8-3c32f82f6415 service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received event network-vif-unplugged-764f8775-3274-4813-97b0-4514b81b7c2e for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Instance destroyed successfully.
Apr 12 06:44:44 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'resources' on Instance uuid 51402ffe-ef35-41a3-811b-5a00788a13d8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:38:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2019289684',display_name='tempest-ServerActionsTestJSON-server-2019289684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2019289684',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:40:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-6qrxgbgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:41:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=51402ffe-ef35-41a3-811b-5a00788a13d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "764f8775-3274-4813-97b0-4514b81b7c2e", "address": "fa:16:3e:7b:ab:03", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap764f8775-32", "ovs_interfaceid": "764f8775-3274-4813-97b0-4514b81b7c2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_vif [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap764f8775-32, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:44:44 user nova-compute[71711]: INFO os_vif [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:ab:03,bridge_name='br-int',has_traffic_filtering=True,id=764f8775-3274-4813-97b0-4514b81b7c2e,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap764f8775-32')
Apr 12 06:44:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMIEsORw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:44:44 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[67087e87-1da0-4330-8a50-e98dac30c0e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:44:44 user nova-compute[71711]: No targets found.
Apr 12 06:44:44 user nova-compute[71711]: iSNS:
Apr 12 06:44:44 user nova-compute[71711]: No targets found.
Apr 12 06:44:44 user nova-compute[71711]: STATIC:
Apr 12 06:44:44 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7
Apr 12 06:44:44 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:44:44 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:44:44 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:44:44 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:44:44 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:44:44 user nova-compute[71711]: FIRMWARE:
Apr 12 06:44:44 user nova-compute[71711]: No targets found.
Apr 12 06:44:44 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:44:44 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:44:44 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2ff6fb-6cdb-436c-b53b-94bfeecc3652]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f717f516-bf2d-41c8-9567-511682d13815]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:44:44 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:44:44 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:44:44 user nova-compute[71711]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 (non-flash)
Apr 12 06:44:44 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c2735b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7'): ({'sdc'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Removing single pathed devices sdc {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[49deeadd-6361-48e8-b1af-6075552fc120]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[927ae8bf-7bda-4852-9e74-dafab74abace]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Flushing IO for device /dev/sdc {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[852f78a3-841c-4e08-8615-71335d88f682]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d73855-3dd8-4fc7-9310-ccc7a9a1ffb2]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23861643530663738', '/dev/disk/by-id/scsi-1SCST_BIO47a70ac2-8ad50f7874045927', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_47a70ac2') {{(pid=81777) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d869c8-413d-4807-85e7-ea41a8c29ee7]: (4, None) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[06640cb0-7363-441e-8f93-15e27b1f6e4d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc401d1-e19e-42e4-9207-6b29c15e2968]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260]
Apr 12 06:44:45 user nova-compute[71711]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7, portal: 172.16.0.220,3260] successful.
Apr 12 06:44:45 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:44:45 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:44:45 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9119eb-174e-4df6-9609-4731fca4240e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:44:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:44:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:44:45 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] <== disconnect_volume: return (318ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:44:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:44:45 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Deleting instance files /opt/stack/data/nova/instances/51402ffe-ef35-41a3-811b-5a00788a13d8_del
Apr 12 06:44:45 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Deletion of /opt/stack/data/nova/instances/51402ffe-ef35-41a3-811b-5a00788a13d8_del complete
Apr 12 06:44:45 user nova-compute[71711]: INFO nova.compute.manager [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 12 06:44:45 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:44:45 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:44:45 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:44:45 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:44:45 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Took 0.78 seconds to deallocate network for instance.
Apr 12 06:44:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received event network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] Acquiring lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] No waiting events found dispatching network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:44:46 user nova-compute[71711]: WARNING nova.compute.manager [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received unexpected event network-vif-plugged-764f8775-3274-4813-97b0-4514b81b7c2e for instance with vm_state active and task_state deleting.
Apr 12 06:44:46 user nova-compute[71711]: DEBUG nova.compute.manager [req-8f2a9a58-e5cb-4686-9eda-c80009dba9ff req-b4991fc2-ad34-4f7b-a274-49fc56a98aca service nova] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Received event network-vif-deleted-764f8775-3274-4813-97b0-4514b81b7c2e {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:44:46 user nova-compute[71711]: INFO nova.compute.manager [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Took 0.75 seconds to detach 1 volumes for instance.
Apr 12 06:44:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Deleting volume: 6cf0ffde-0da4-48e7-9e70-a526ad0a3bd7 {{(pid=71711) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 06:44:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:44:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:44:46 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:44:47 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:44:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:47 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Deleted allocations for instance 51402ffe-ef35-41a3-811b-5a00788a13d8
Apr 12 06:44:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e99c78a6-d1e9-456a-a6d2-e6cc6d7f223a tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "51402ffe-ef35-41a3-811b-5a00788a13d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.215s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:44:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:44:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:44:58 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:44:59 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281884.7022934, 51402ffe-ef35-41a3-811b-5a00788a13d8 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:44:59 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] VM Stopped (Lifecycle Event)
Apr 12 06:44:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-46a7e30b-2f06-4e58-9694-2bff9149d589 None None] [instance: 51402ffe-ef35-41a3-811b-5a00788a13d8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:44:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:44:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:44:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:44:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:44:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:44:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:45:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:45:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:45:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid 0a6c87b7-75d7-429e-9f7b-e8a959f1791f {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Updating instance_info_cache with network_info: [{"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-0a6c87b7-75d7-429e-9f7b-e8a959f1791f" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:02 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:45:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:03 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:45:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:03 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:04 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:45:04 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:45:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8469MB free_disk=26.174026489257812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 5364688b-cc08-4407-94f5-974846ae7bb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 659489bb-3672-4f70-9ab5-b37f310a7d86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:05 user nova-compute[71711]: INFO nova.compute.manager [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Terminating instance
Apr 12 06:45:05 user nova-compute[71711]: DEBUG nova.compute.manager [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG nova.compute.manager [req-a74ed932-ad6b-40b1-ac5b-33055ecb4a7e req-409105a5-757d-477a-91dd-a20f100e4fb0 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-unplugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a74ed932-ad6b-40b1-ac5b-33055ecb4a7e req-409105a5-757d-477a-91dd-a20f100e4fb0 service nova] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a74ed932-ad6b-40b1-ac5b-33055ecb4a7e req-409105a5-757d-477a-91dd-a20f100e4fb0 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a74ed932-ad6b-40b1-ac5b-33055ecb4a7e req-409105a5-757d-477a-91dd-a20f100e4fb0 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG nova.compute.manager [req-a74ed932-ad6b-40b1-ac5b-33055ecb4a7e req-409105a5-757d-477a-91dd-a20f100e4fb0 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] No waiting events found dispatching network-vif-unplugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG nova.compute.manager [req-a74ed932-ad6b-40b1-ac5b-33055ecb4a7e req-409105a5-757d-477a-91dd-a20f100e4fb0 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-unplugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:06 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Instance destroyed successfully.
Apr 12 06:45:06 user nova-compute[71711]: DEBUG nova.objects.instance [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'resources' on Instance uuid ebb36f74-c4a3-4108-949d-1fb8918f9a8c {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:29:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2071604680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2071604680',id=20,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:31:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-8q0yisgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:33:08Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=ebb36f74-c4a3-4108-949d-1fb8918f9a8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "address": "fa:16:3e:33:83:aa", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0beef467-c0", "ovs_interfaceid": "0beef467-c01f-4521-8d4a-85c0f1f7dd1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=0beef467-c01f-4521-8d4a-85c0f1f7dd1f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beef467-c0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_vif [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=0beef467-c01f-4521-8d4a-85c0f1f7dd1f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beef467-c0') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0beef467-c0, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:45:06 user nova-compute[71711]: INFO os_vif [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:83:aa,bridge_name='br-int',has_traffic_filtering=True,id=0beef467-c01f-4521-8d4a-85c0f1f7dd1f,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0beef467-c0')
Apr 12 06:45:06 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KQizkfug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:45:06 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[600bda52-aa84-4af4-b725-bfbf6710bb73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:45:06 user nova-compute[71711]: No targets found.
Apr 12 06:45:06 user nova-compute[71711]: iSNS:
Apr 12 06:45:06 user nova-compute[71711]: No targets found.
Apr 12 06:45:06 user nova-compute[71711]: STATIC:
Apr 12 06:45:06 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297
Apr 12 06:45:06 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:45:06 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:45:06 user nova-compute[71711]: FIRMWARE:
Apr 12 06:45:06 user nova-compute[71711]: No targets found.
Apr 12 06:45:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:45:06 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:45:06 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d6623d-0e14-4b60-8c3a-cde0d16ae826]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d052e8-de00-4985-9e2a-d6b355f90d23]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:45:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 (non-flash)
Apr 12 06:45:06 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c6b6ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297'): ({'sdb'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Removing single pathed devices sdb {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[72abfdcb-de4c-42de-ba10-c5b6ac149954]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ff569e-5ea8-40c0-bd5b-da757e243eea]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Flushing IO for device /dev/sdb {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1895a69c-5472-4436-9dec-a8f83fa6fc62]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddc08f5-22be-4839-bd49-eb7b6bce8e84]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[164e73e4-361b-418d-b164-3f63b3040b71]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:45:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:07 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a2f8a1-7dfa-4f74-8080-85ce446d418e]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:45:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297, portal: 172.16.0.220,3260]
Apr 12 06:45:07 user nova-compute[71711]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297, portal: 172.16.0.220,3260] successful.
Apr 12 06:45:07 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:45:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9013e447-dbe0-46fc-97fe-c8d65768b297 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:07 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a210b394-b595-4463-8cb8-1b42b4622c04]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:45:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:45:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:45:07 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] <== disconnect_volume: return (276ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:45:07 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:45:07 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Deleting instance files /opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c_del
Apr 12 06:45:07 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Deletion of /opt/stack/data/nova/instances/ebb36f74-c4a3-4108-949d-1fb8918f9a8c_del complete
Apr 12 06:45:07 user nova-compute[71711]: INFO nova.compute.manager [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Took 1.11 seconds to destroy the instance on the hypervisor.
Apr 12 06:45:07 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:45:07 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:45:07 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:45:07 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:45:07 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Took 0.42 seconds to deallocate network for instance.
Apr 12 06:45:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] Acquiring lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] No waiting events found dispatching network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:45:08 user nova-compute[71711]: WARNING nova.compute.manager [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received unexpected event network-vif-plugged-0beef467-c01f-4521-8d4a-85c0f1f7dd1f for instance with vm_state active and task_state deleting.
Apr 12 06:45:08 user nova-compute[71711]: DEBUG nova.compute.manager [req-699f38ee-3eef-4ae4-978b-6e191f820f59 req-10d759cc-a7c8-4b35-8c08-aadbdb356162 service nova] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Received event network-vif-deleted-0beef467-c01f-4521-8d4a-85c0f1f7dd1f {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:08 user nova-compute[71711]: INFO nova.compute.manager [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Took 0.79 seconds to detach 1 volumes for instance.
Apr 12 06:45:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:08 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:45:08 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:45:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:08 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Deleted allocations for instance ebb36f74-c4a3-4108-949d-1fb8918f9a8c
Apr 12 06:45:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-fd343274-5a27-4243-8f35-5945f29017d3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "ebb36f74-c4a3-4108-949d-1fb8918f9a8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.673s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "5364688b-cc08-4407-94f5-974846ae7bb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:13 user nova-compute[71711]: INFO nova.compute.manager [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Terminating instance
Apr 12 06:45:13 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-1d117526-4058-4168-b10d-fd5e68548137 req-50cb3e62-4f46-46e3-a541-dff7143e69d1 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-unplugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1d117526-4058-4168-b10d-fd5e68548137 req-50cb3e62-4f46-46e3-a541-dff7143e69d1 service nova] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1d117526-4058-4168-b10d-fd5e68548137 req-50cb3e62-4f46-46e3-a541-dff7143e69d1 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1d117526-4058-4168-b10d-fd5e68548137 req-50cb3e62-4f46-46e3-a541-dff7143e69d1 service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-1d117526-4058-4168-b10d-fd5e68548137 req-50cb3e62-4f46-46e3-a541-dff7143e69d1 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] No waiting events found dispatching network-vif-unplugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG nova.compute.manager [req-1d117526-4058-4168-b10d-fd5e68548137 req-50cb3e62-4f46-46e3-a541-dff7143e69d1 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-unplugged-92e5c952-1e00-4dde-8dcc-dc876149d896 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:13 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Instance destroyed successfully.
Apr 12 06:45:13 user nova-compute[71711]: DEBUG nova.objects.instance [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lazy-loading 'resources' on Instance uuid 5364688b-cc08-4407-94f5-974846ae7bb8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-457399220',display_name='tempest-ServerRescueNegativeTestJSON-server-457399220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-457399220',id=17,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:33:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='972842dc32ee4687866dfe2fbefe9cb4',ramdisk_id='',reservation_id='r-042stp6b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1179647693',owner_user_name='tempest-ServerRescueNegativeTestJSON-1179647693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:35:06Z,user_data=None,user_id='dc8e6af1db834409a4880040a5ef6a5a',uuid=5364688b-cc08-4407-94f5-974846ae7bb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converting VIF {"id": "92e5c952-1e00-4dde-8dcc-dc876149d896", "address": "fa:16:3e:42:29:c8", "network": {"id": "98448a26-3482-4eb6-91b1-bf8b0c18a3eb", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-749852965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "972842dc32ee4687866dfe2fbefe9cb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e5c952-1e", "ovs_interfaceid": "92e5c952-1e00-4dde-8dcc-dc876149d896", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=92e5c952-1e00-4dde-8dcc-dc876149d896,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e5c952-1e') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG os_vif [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=92e5c952-1e00-4dde-8dcc-dc876149d896,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e5c952-1e') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92e5c952-1e, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:45:13 user nova-compute[71711]: INFO os_vif [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=92e5c952-1e00-4dde-8dcc-dc876149d896,network=Network(98448a26-3482-4eb6-91b1-bf8b0c18a3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e5c952-1e')
Apr 12 06:45:13 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Deleting instance files /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8_del
Apr 12 06:45:13 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Deletion of /opt/stack/data/nova/instances/5364688b-cc08-4407-94f5-974846ae7bb8_del complete
Apr 12 06:45:13 user nova-compute[71711]: INFO nova.compute.manager [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 12 06:45:13 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:45:13 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:45:14 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:45:14 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Took 0.42 seconds to deallocate network for instance.
Apr 12 06:45:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-398818ba-ca48-480d-b784-b358b5196677 req-ede1e5ad-a3eb-4d8e-b4b9-d5864ae41011 service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-deleted-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:14 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:45:14 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:45:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:14 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Deleted allocations for instance 5364688b-cc08-4407-94f5-974846ae7bb8
Apr 12 06:45:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-3d8da2c5-eb42-4c68-860b-7797ddfdba3c tempest-ServerRescueNegativeTestJSON-1179647693 tempest-ServerRescueNegativeTestJSON-1179647693-project-member] Lock "5364688b-cc08-4407-94f5-974846ae7bb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.423s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-28a64790-38ff-48b7-866a-c859997f45e8 req-4239aae5-5f79-40f8-a44a-44106cb7b60a service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-28a64790-38ff-48b7-866a-c859997f45e8 req-4239aae5-5f79-40f8-a44a-44106cb7b60a service nova] Acquiring lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-28a64790-38ff-48b7-866a-c859997f45e8 req-4239aae5-5f79-40f8-a44a-44106cb7b60a service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-28a64790-38ff-48b7-866a-c859997f45e8 req-4239aae5-5f79-40f8-a44a-44106cb7b60a service nova] Lock "5364688b-cc08-4407-94f5-974846ae7bb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:15 user nova-compute[71711]: DEBUG nova.compute.manager [req-28a64790-38ff-48b7-866a-c859997f45e8 req-4239aae5-5f79-40f8-a44a-44106cb7b60a service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] No waiting events found dispatching network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:45:15 user nova-compute[71711]: WARNING nova.compute.manager [req-28a64790-38ff-48b7-866a-c859997f45e8 req-4239aae5-5f79-40f8-a44a-44106cb7b60a service nova] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Received unexpected event network-vif-plugged-92e5c952-1e00-4dde-8dcc-dc876149d896 for instance with vm_state deleted and task_state None.
Apr 12 06:45:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:45:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:45:21 user nova-compute[71711]: INFO nova.compute.claims [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Claim successful on node user
Apr 12 06:45:21 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281906.7243714, ebb36f74-c4a3-4108-949d-1fb8918f9a8c => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:45:21 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] VM Stopped (Lifecycle Event)
Apr 12 06:45:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-11ffd0d7-94be-45f8-8b3f-64b6d081bce2 None None] [instance: ebb36f74-c4a3-4108-949d-1fb8918f9a8c] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:45:21 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:45:21 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:45:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:45:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:45:21 user nova-compute[71711]: DEBUG nova.network.neutron [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:45:21 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:45:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG nova.policy [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8546fd1ed08b4e88a945e73347be38c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34529636fc4221921028f93b1c381a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:45:22 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Creating image(s)
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "/opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "/opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "/opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk 1073741824" returned: 0 in 0.055s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG nova.network.neutron [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Successfully created port: 2923dc36-c11b-43e4-afed-fb46cc033110 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Cannot resize image /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG nova.objects.instance [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'migration_context' on Instance uuid 20f055ae-909d-4fda-a2d5-0f4aef77928e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Ensure instance console log exists: /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.network.neutron [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Successfully updated port: 2923dc36-c11b-43e4-afed-fb46cc033110 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "refresh_cache-20f055ae-909d-4fda-a2d5-0f4aef77928e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquired lock "refresh_cache-20f055ae-909d-4fda-a2d5-0f4aef77928e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.network.neutron [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Received event network-changed-2923dc36-c11b-43e4-afed-fb46cc033110 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Refreshing instance network info cache due to event network-changed-2923dc36-c11b-43e4-afed-fb46cc033110. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] Acquiring lock "refresh_cache-20f055ae-909d-4fda-a2d5-0f4aef77928e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.network.neutron [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.network.neutron [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Updating instance_info_cache with network_info: [{"id": "2923dc36-c11b-43e4-afed-fb46cc033110", "address": "fa:16:3e:8f:d5:67", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2923dc36-c1", "ovs_interfaceid": "2923dc36-c11b-43e4-afed-fb46cc033110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Releasing lock "refresh_cache-20f055ae-909d-4fda-a2d5-0f4aef77928e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Instance network_info: |[{"id": "2923dc36-c11b-43e4-afed-fb46cc033110", "address": "fa:16:3e:8f:d5:67", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2923dc36-c1", "ovs_interfaceid": "2923dc36-c11b-43e4-afed-fb46cc033110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] Acquired lock "refresh_cache-20f055ae-909d-4fda-a2d5-0f4aef77928e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.network.neutron [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Refreshing network info cache for port 2923dc36-c11b-43e4-afed-fb46cc033110 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Start _get_guest_xml network_info=[{"id": "2923dc36-c11b-43e4-afed-fb46cc033110", "address": "fa:16:3e:8f:d5:67", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2923dc36-c1", "ovs_interfaceid": "2923dc36-c11b-43e4-afed-fb46cc033110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:45:23 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:45:23 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1542125927',display_name='tempest-VolumesSnapshotTestJSON-instance-1542125927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1542125927',id=36,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af34529636fc4221921028f93b1c381a',ramdisk_id='',reservation_id='r-wwxvhzdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2015355536',owner_user_name='tempest-VolumesSnapshotTestJSON-2015355536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:45:22Z,user_data=None,user_id='8546fd1ed08b4e88a945e73347be38c2',uuid=20f055ae-909d-4fda-a2d5-0f4aef77928e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2923dc36-c11b-43e4-afed-fb46cc033110", "address": "fa:16:3e:8f:d5:67", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2923dc36-c1", "ovs_interfaceid": "2923dc36-c11b-43e4-afed-fb46cc033110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Converting VIF {"id": "2923dc36-c11b-43e4-afed-fb46cc033110", "address": "fa:16:3e:8f:d5:67", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2923dc36-c1", "ovs_interfaceid": "2923dc36-c11b-43e4-afed-fb46cc033110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2923dc36-c11b-43e4-afed-fb46cc033110,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2923dc36-c1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.objects.instance [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'pci_devices' on Instance uuid 20f055ae-909d-4fda-a2d5-0f4aef77928e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:45:23 user nova-compute[71711]:   <uuid>20f055ae-909d-4fda-a2d5-0f4aef77928e</uuid>
Apr 12 06:45:23 user nova-compute[71711]:   <name>instance-00000024</name>
Apr 12 06:45:23 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:45:23 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:45:23 user nova-compute[71711]:   <metadata>
Apr 12 06:45:23 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:45:23 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:45:23 user nova-compute[71711]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1542125927</nova:name>
Apr 12 06:45:23 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:45:23</nova:creationTime>
Apr 12 06:45:23 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:45:23 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:45:23 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:45:23 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:45:23 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:45:23 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:45:23 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:45:23 user nova-compute[71711]:       <nova:owner>
Apr 12 06:45:23 user nova-compute[71711]:         <nova:user uuid="8546fd1ed08b4e88a945e73347be38c2">tempest-VolumesSnapshotTestJSON-2015355536-project-member</nova:user>
Apr 12 06:45:23 user nova-compute[71711]:         <nova:project uuid="af34529636fc4221921028f93b1c381a">tempest-VolumesSnapshotTestJSON-2015355536</nova:project>
Apr 12 06:45:23 user nova-compute[71711]:       </nova:owner>
Apr 12 06:45:23 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:45:23 user nova-compute[71711]:       <nova:ports>
Apr 12 06:45:23 user nova-compute[71711]:         <nova:port uuid="2923dc36-c11b-43e4-afed-fb46cc033110">
Apr 12 06:45:23 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:45:23 user nova-compute[71711]:         </nova:port>
Apr 12 06:45:23 user nova-compute[71711]:       </nova:ports>
Apr 12 06:45:23 user nova-compute[71711]:     </nova:instance>
Apr 12 06:45:23 user nova-compute[71711]:   </metadata>
Apr 12 06:45:23 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:45:23 user nova-compute[71711]:     <system>
Apr 12 06:45:23 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:45:23 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:45:23 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:45:23 user nova-compute[71711]:       <entry name="serial">20f055ae-909d-4fda-a2d5-0f4aef77928e</entry>
Apr 12 06:45:23 user nova-compute[71711]:       <entry name="uuid">20f055ae-909d-4fda-a2d5-0f4aef77928e</entry>
Apr 12 06:45:23 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:45:23 user nova-compute[71711]:     </system>
Apr 12 06:45:23 user nova-compute[71711]:   </sysinfo>
Apr 12 06:45:23 user nova-compute[71711]:   <os>
Apr 12 06:45:23 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:45:23 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:45:23 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:45:23 user nova-compute[71711]:   </os>
Apr 12 06:45:23 user nova-compute[71711]:   <features>
Apr 12 06:45:23 user nova-compute[71711]:     <acpi/>
Apr 12 06:45:23 user nova-compute[71711]:     <apic/>
Apr 12 06:45:23 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:45:23 user nova-compute[71711]:   </features>
Apr 12 06:45:23 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:45:23 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:45:23 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:45:23 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:45:23 user nova-compute[71711]:   </clock>
Apr 12 06:45:23 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:45:23 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:45:23 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:45:23 user nova-compute[71711]:   </cpu>
Apr 12 06:45:23 user nova-compute[71711]:   <devices>
Apr 12 06:45:23 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:45:23 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:45:23 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk"/>
Apr 12 06:45:23 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:45:23 user nova-compute[71711]:     </disk>
Apr 12 06:45:23 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:45:23 user nova-compute[71711]:       <mac address="fa:16:3e:8f:d5:67"/>
Apr 12 06:45:23 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:45:23 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:45:23 user nova-compute[71711]:       <target dev="tap2923dc36-c1"/>
Apr 12 06:45:23 user nova-compute[71711]:     </interface>
Apr 12 06:45:23 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:45:23 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/console.log" append="off"/>
Apr 12 06:45:23 user nova-compute[71711]:     </serial>
Apr 12 06:45:23 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:45:23 user nova-compute[71711]:     <video>
Apr 12 06:45:23 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:45:23 user nova-compute[71711]:     </video>
Apr 12 06:45:23 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:45:23 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:45:23 user nova-compute[71711]:     </rng>
Apr 12 06:45:23 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:45:23 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:45:23 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:45:23 user nova-compute[71711]:     </memballoon>
Apr 12 06:45:23 user nova-compute[71711]:   </devices>
Apr 12 06:45:23 user nova-compute[71711]: </domain>
Apr 12 06:45:23 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1542125927',display_name='tempest-VolumesSnapshotTestJSON-instance-1542125927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1542125927',id=36,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af34529636fc4221921028f93b1c381a',ramdisk_id='',reservation_id='r-wwxvhzdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2015355536',owner_user_name='tempest-VolumesSnapshotTestJSON-2015355536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:45:22Z,user_data=None,user_id='8546fd1ed08b4e88a945e73347be38c2',uuid=20f055ae-909d-4fda-a2d5-0f4aef77928e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2923dc36-c11b-43e4-afed-fb46cc033110", "address": "fa:16:3e:8f:d5:67", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2923dc36-c1", "ovs_interfaceid": "2923dc36-c11b-43e4-afed-fb46cc033110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Converting VIF {"id": "2923dc36-c11b-43e4-afed-fb46cc033110", "address": "fa:16:3e:8f:d5:67", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2923dc36-c1", "ovs_interfaceid": "2923dc36-c11b-43e4-afed-fb46cc033110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2923dc36-c11b-43e4-afed-fb46cc033110,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2923dc36-c1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG os_vif [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2923dc36-c11b-43e4-afed-fb46cc033110,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2923dc36-c1') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2923dc36-c1, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2923dc36-c1, col_values=(('external_ids', {'iface-id': '2923dc36-c11b-43e4-afed-fb46cc033110', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:d5:67', 'vm-uuid': '20f055ae-909d-4fda-a2d5-0f4aef77928e'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:23 user nova-compute[71711]: INFO os_vif [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2923dc36-c11b-43e4-afed-fb46cc033110,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2923dc36-c1')
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:45:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] No VIF found with MAC fa:16:3e:8f:d5:67, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:45:24 user nova-compute[71711]: DEBUG nova.network.neutron [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Updated VIF entry in instance network info cache for port 2923dc36-c11b-43e4-afed-fb46cc033110. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:45:24 user nova-compute[71711]: DEBUG nova.network.neutron [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Updating instance_info_cache with network_info: [{"id": "2923dc36-c11b-43e4-afed-fb46cc033110", "address": "fa:16:3e:8f:d5:67", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2923dc36-c1", "ovs_interfaceid": "2923dc36-c11b-43e4-afed-fb46cc033110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:45:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-94eded5e-ee18-4750-b1df-0458c5a47cb8 req-a47888fe-e9f6-4abf-91c5-df6cabd07e0c service nova] Releasing lock "refresh_cache-20f055ae-909d-4fda-a2d5-0f4aef77928e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:45:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-13e6d617-0619-4c2e-891f-48a395cdd66f req-aefd363f-aa03-4f5d-8e59-ecdef71dd96f service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Received event network-vif-plugged-2923dc36-c11b-43e4-afed-fb46cc033110 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-13e6d617-0619-4c2e-891f-48a395cdd66f req-aefd363f-aa03-4f5d-8e59-ecdef71dd96f service nova] Acquiring lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-13e6d617-0619-4c2e-891f-48a395cdd66f req-aefd363f-aa03-4f5d-8e59-ecdef71dd96f service nova] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-13e6d617-0619-4c2e-891f-48a395cdd66f req-aefd363f-aa03-4f5d-8e59-ecdef71dd96f service nova] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-13e6d617-0619-4c2e-891f-48a395cdd66f req-aefd363f-aa03-4f5d-8e59-ecdef71dd96f service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] No waiting events found dispatching network-vif-plugged-2923dc36-c11b-43e4-afed-fb46cc033110 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:45:25 user nova-compute[71711]: WARNING nova.compute.manager [req-13e6d617-0619-4c2e-891f-48a395cdd66f req-aefd363f-aa03-4f5d-8e59-ecdef71dd96f service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Received unexpected event network-vif-plugged-2923dc36-c11b-43e4-afed-fb46cc033110 for instance with vm_state building and task_state spawning.
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281927.731467, 20f055ae-909d-4fda-a2d5-0f4aef77928e => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:45:27 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] VM Resumed (Lifecycle Event)
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:45:27 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Instance spawned successfully.
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:45:27 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281927.732836, 20f055ae-909d-4fda-a2d5-0f4aef77928e => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:45:27 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] VM Started (Lifecycle Event)
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:45:27 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:45:27 user nova-compute[71711]: INFO nova.compute.manager [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Took 5.72 seconds to spawn the instance on the hypervisor.
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-a8867516-503c-4228-90ba-e5f4973bd209 req-cbe23426-2093-417f-89bb-c74a950c1cf1 service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Received event network-vif-plugged-2923dc36-c11b-43e4-afed-fb46cc033110 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a8867516-503c-4228-90ba-e5f4973bd209 req-cbe23426-2093-417f-89bb-c74a950c1cf1 service nova] Acquiring lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a8867516-503c-4228-90ba-e5f4973bd209 req-cbe23426-2093-417f-89bb-c74a950c1cf1 service nova] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a8867516-503c-4228-90ba-e5f4973bd209 req-cbe23426-2093-417f-89bb-c74a950c1cf1 service nova] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-a8867516-503c-4228-90ba-e5f4973bd209 req-cbe23426-2093-417f-89bb-c74a950c1cf1 service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] No waiting events found dispatching network-vif-plugged-2923dc36-c11b-43e4-afed-fb46cc033110 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:45:27 user nova-compute[71711]: WARNING nova.compute.manager [req-a8867516-503c-4228-90ba-e5f4973bd209 req-cbe23426-2093-417f-89bb-c74a950c1cf1 service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Received unexpected event network-vif-plugged-2923dc36-c11b-43e4-afed-fb46cc033110 for instance with vm_state active and task_state None.
Apr 12 06:45:27 user nova-compute[71711]: INFO nova.compute.manager [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Took 6.27 seconds to build instance.
Apr 12 06:45:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c22a8b6d-21f3-4301-977a-3f814b7f49ed tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.368s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:28 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281913.581552, 5364688b-cc08-4407-94f5-974846ae7bb8 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:45:28 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] VM Stopped (Lifecycle Event)
Apr 12 06:45:28 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4350dcb6-5aa4-4d02-8bc4-dfe75be0c786 None None] [instance: 5364688b-cc08-4407-94f5-974846ae7bb8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:45:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "659489bb-3672-4f70-9ab5-b37f310a7d86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:34 user nova-compute[71711]: INFO nova.compute.manager [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Terminating instance
Apr 12 06:45:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-54378530-62d4-4988-9ec9-6b6ead4aa102 req-d8f8a87a-e2d1-466e-8b46-053376ab293c service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Received event network-vif-unplugged-744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-54378530-62d4-4988-9ec9-6b6ead4aa102 req-d8f8a87a-e2d1-466e-8b46-053376ab293c service nova] Acquiring lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-54378530-62d4-4988-9ec9-6b6ead4aa102 req-d8f8a87a-e2d1-466e-8b46-053376ab293c service nova] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-54378530-62d4-4988-9ec9-6b6ead4aa102 req-d8f8a87a-e2d1-466e-8b46-053376ab293c service nova] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-54378530-62d4-4988-9ec9-6b6ead4aa102 req-d8f8a87a-e2d1-466e-8b46-053376ab293c service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] No waiting events found dispatching network-vif-unplugged-744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:45:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-54378530-62d4-4988-9ec9-6b6ead4aa102 req-d8f8a87a-e2d1-466e-8b46-053376ab293c service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Received event network-vif-unplugged-744814ae-b032-41e5-b122-8d5ff605d349 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:45:35 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Instance destroyed successfully.
Apr 12 06:45:35 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lazy-loading 'resources' on Instance uuid 659489bb-3672-4f70-9ab5-b37f310a7d86 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:36:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-691857628',display_name='tempest-ServerActionsTestJSON-server-691857628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-691857628',id=29,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBNlx01v/vAUpW4J7gPa6qOD+34jF3/qWXF3LutWHc6T4nIcve1iKgOcC2ZBFdqMU0vNH2vxuGXnrQ5Eg8bncWs4Zjafh2FwJ0BWfa7POZFyHFu7+TMmfcIMekxU3yZuQ==',key_name='tempest-keypair-1698395184',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:36:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54fd87c4105246c1ac1bdf424c83b7aa',ramdisk_id='',reservation_id='r-7sp5riz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-752347644',owner_user_name='tempest-ServerActionsTestJSON-752347644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:36:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad316acdc89947bbba60c75e9a24d7e9',uuid=659489bb-3672-4f70-9ab5-b37f310a7d86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "744814ae-b032-41e5-b122-8d5ff605d349", "address": "fa:16:3e:c2:8c:71", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744814ae-b0", "ovs_interfaceid": "744814ae-b032-41e5-b122-8d5ff605d349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converting VIF {"id": "744814ae-b032-41e5-b122-8d5ff605d349", "address": "fa:16:3e:c2:8c:71", "network": {"id": "e7da68c2-65d3-464a-9293-6e43665b2422", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-566357441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54fd87c4105246c1ac1bdf424c83b7aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap744814ae-b0", "ovs_interfaceid": "744814ae-b032-41e5-b122-8d5ff605d349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:8c:71,bridge_name='br-int',has_traffic_filtering=True,id=744814ae-b032-41e5-b122-8d5ff605d349,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744814ae-b0') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG os_vif [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:8c:71,bridge_name='br-int',has_traffic_filtering=True,id=744814ae-b032-41e5-b122-8d5ff605d349,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744814ae-b0') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap744814ae-b0, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:45:35 user nova-compute[71711]: INFO os_vif [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:8c:71,bridge_name='br-int',has_traffic_filtering=True,id=744814ae-b032-41e5-b122-8d5ff605d349,network=Network(e7da68c2-65d3-464a-9293-6e43665b2422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap744814ae-b0')
Apr 12 06:45:35 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Deleting instance files /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86_del
Apr 12 06:45:35 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Deletion of /opt/stack/data/nova/instances/659489bb-3672-4f70-9ab5-b37f310a7d86_del complete
Apr 12 06:45:35 user nova-compute[71711]: INFO nova.compute.manager [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 12 06:45:35 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:45:35 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Took 0.42 seconds to deallocate network for instance.
Apr 12 06:45:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:45:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:35 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Deleted allocations for instance 659489bb-3672-4f70-9ab5-b37f310a7d86
Apr 12 06:45:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a84a5bc3-a875-4af3-aa2f-a3603a7ceacc tempest-ServerActionsTestJSON-752347644 tempest-ServerActionsTestJSON-752347644-project-member] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.441s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:36 user nova-compute[71711]: DEBUG nova.compute.manager [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Received event network-vif-plugged-744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] Acquiring lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] Lock "659489bb-3672-4f70-9ab5-b37f310a7d86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:36 user nova-compute[71711]: DEBUG nova.compute.manager [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] No waiting events found dispatching network-vif-plugged-744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:45:36 user nova-compute[71711]: WARNING nova.compute.manager [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Received unexpected event network-vif-plugged-744814ae-b032-41e5-b122-8d5ff605d349 for instance with vm_state deleted and task_state None.
Apr 12 06:45:36 user nova-compute[71711]: DEBUG nova.compute.manager [req-54f0fc88-d8bf-4b22-aef6-d515b773e855 req-961fe198-ec11-4fd5-9a7f-30afe80e68bb service nova] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Received event network-vif-deleted-744814ae-b032-41e5-b122-8d5ff605d349 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:50 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281935.0158172, 659489bb-3672-4f70-9ab5-b37f310a7d86 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:45:50 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] VM Stopped (Lifecycle Event)
Apr 12 06:45:50 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1b6749ca-b58d-4505-9c15-e6cbe191e856 None None] [instance: 659489bb-3672-4f70-9ab5-b37f310a7d86] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:45:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:56 user nova-compute[71711]: INFO nova.compute.manager [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Terminating instance
Apr 12 06:45:56 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-0471512b-1b9d-4b2c-a914-6575526eef93 req-57c3b6e6-602f-451e-9233-83beb9665cb0 service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Received event network-vif-unplugged-c9e9de0e-798c-49fb-aeb3-30eccc267206 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0471512b-1b9d-4b2c-a914-6575526eef93 req-57c3b6e6-602f-451e-9233-83beb9665cb0 service nova] Acquiring lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0471512b-1b9d-4b2c-a914-6575526eef93 req-57c3b6e6-602f-451e-9233-83beb9665cb0 service nova] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0471512b-1b9d-4b2c-a914-6575526eef93 req-57c3b6e6-602f-451e-9233-83beb9665cb0 service nova] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-0471512b-1b9d-4b2c-a914-6575526eef93 req-57c3b6e6-602f-451e-9233-83beb9665cb0 service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] No waiting events found dispatching network-vif-unplugged-c9e9de0e-798c-49fb-aeb3-30eccc267206 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:45:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-0471512b-1b9d-4b2c-a914-6575526eef93 req-57c3b6e6-602f-451e-9233-83beb9665cb0 service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Received event network-vif-unplugged-c9e9de0e-798c-49fb-aeb3-30eccc267206 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:45:57 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Instance destroyed successfully.
Apr 12 06:45:57 user nova-compute[71711]: DEBUG nova.objects.instance [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lazy-loading 'resources' on Instance uuid 0a6c87b7-75d7-429e-9f7b-e8a959f1791f {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:45:57 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:26:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-996712143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-996712143',id=15,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:26:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ecae91e53ee4d70a8dc24c7febc2a0e',ramdisk_id='',reservation_id='r-ke6c9y5r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:28:19Z,user_data=None,user_id='2e5e4455358643b8830ce8c96aad5aad',uuid=0a6c87b7-75d7-429e-9f7b-e8a959f1791f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:45:57 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converting VIF {"id": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "address": "fa:16:3e:40:34:34", "network": {"id": "c152f4eb-1dbe-4252-b242-3f911e389655", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1902083067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ecae91e53ee4d70a8dc24c7febc2a0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9e9de0e-79", "ovs_interfaceid": "c9e9de0e-798c-49fb-aeb3-30eccc267206", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:45:57 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:34:34,bridge_name='br-int',has_traffic_filtering=True,id=c9e9de0e-798c-49fb-aeb3-30eccc267206,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e9de0e-79') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:45:57 user nova-compute[71711]: DEBUG os_vif [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:34:34,bridge_name='br-int',has_traffic_filtering=True,id=c9e9de0e-798c-49fb-aeb3-30eccc267206,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e9de0e-79') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:45:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9e9de0e-79, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:45:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:45:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:45:57 user nova-compute[71711]: INFO os_vif [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:34:34,bridge_name='br-int',has_traffic_filtering=True,id=c9e9de0e-798c-49fb-aeb3-30eccc267206,network=Network(c152f4eb-1dbe-4252-b242-3f911e389655),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9e9de0e-79')
Apr 12 06:45:57 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Deleting instance files /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f_del
Apr 12 06:45:57 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Deletion of /opt/stack/data/nova/instances/0a6c87b7-75d7-429e-9f7b-e8a959f1791f_del complete
Apr 12 06:45:57 user nova-compute[71711]: INFO nova.compute.manager [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 06:45:57 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:45:57 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:45:57 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:45:57 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:45:57 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Took 0.43 seconds to deallocate network for instance.
Apr 12 06:45:57 user nova-compute[71711]: DEBUG nova.compute.manager [req-e5ec946c-d2f5-423c-acb4-32ad0486a96a req-1ebd41e0-e222-4906-ab40-f612503e8bff service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Received event network-vif-deleted-c9e9de0e-798c-49fb-aeb3-30eccc267206 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:57 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:58 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:45:58 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:45:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:58 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Deleted allocations for instance 0a6c87b7-75d7-429e-9f7b-e8a959f1791f
Apr 12 06:45:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-e6065421-05f9-4b57-9331-8ca0f7c08cf3 tempest-ServerBootFromVolumeStableRescueTest-2063268056 tempest-ServerBootFromVolumeStableRescueTest-2063268056-project-member] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.617s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-836cfd09-1630-41f6-8b4c-9e0ba0ef91c5 req-84958493-c8f4-4661-97f8-6da61a26c56b service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Received event network-vif-plugged-c9e9de0e-798c-49fb-aeb3-30eccc267206 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:45:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-836cfd09-1630-41f6-8b4c-9e0ba0ef91c5 req-84958493-c8f4-4661-97f8-6da61a26c56b service nova] Acquiring lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:45:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-836cfd09-1630-41f6-8b4c-9e0ba0ef91c5 req-84958493-c8f4-4661-97f8-6da61a26c56b service nova] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:45:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-836cfd09-1630-41f6-8b4c-9e0ba0ef91c5 req-84958493-c8f4-4661-97f8-6da61a26c56b service nova] Lock "0a6c87b7-75d7-429e-9f7b-e8a959f1791f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:45:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-836cfd09-1630-41f6-8b4c-9e0ba0ef91c5 req-84958493-c8f4-4661-97f8-6da61a26c56b service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] No waiting events found dispatching network-vif-plugged-c9e9de0e-798c-49fb-aeb3-30eccc267206 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:45:58 user nova-compute[71711]: WARNING nova.compute.manager [req-836cfd09-1630-41f6-8b4c-9e0ba0ef91c5 req-84958493-c8f4-4661-97f8-6da61a26c56b service nova] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Received unexpected event network-vif-plugged-c9e9de0e-798c-49fb-aeb3-30eccc267206 for instance with vm_state deleted and task_state None.
Apr 12 06:46:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:46:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:46:01 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:46:01 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:46:02 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:46:02 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:46:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:03 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:46:04 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:46:04 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:46:04 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=26.273761749267578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:05 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 20f055ae-909d-4fda-a2d5-0f4aef77928e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:46:05 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:46:05 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:46:05 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:46:05 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:46:05 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:46:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:46:12 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681281957.3733828, 0a6c87b7-75d7-429e-9f7b-e8a959f1791f => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:46:12 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] VM Stopped (Lifecycle Event)
Apr 12 06:46:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e5ba2393-1777-4d03-822e-fb7c9778d79f None None] [instance: 0a6c87b7-75d7-429e-9f7b-e8a959f1791f] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:46:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:19 user nova-compute[71711]: DEBUG nova.compute.manager [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:46:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:19 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:46:19 user nova-compute[71711]: INFO nova.compute.claims [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Claim successful on node user
Apr 12 06:46:20 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG nova.network.neutron [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:46:20 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:46:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:46:20 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Creating image(s)
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "/opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "/opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG nova.policy [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c93cca7970df482f8c3a00f15ef12fde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5098984b6bda4c2d9a71023292e7815c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.131s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk 1073741824" returned: 0 in 0.056s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:46:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Cannot resize image /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG nova.objects.instance [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lazy-loading 'migration_context' on Instance uuid 9b4783e1-34e3-425c-87c3-ee8bda2c6853 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Ensure instance console log exists: /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG nova.network.neutron [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Successfully created port: ad8cf137-9750-4de8-8c9e-1fca491a3348 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG nova.network.neutron [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Successfully updated port: ad8cf137-9750-4de8-8c9e-1fca491a3348 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "refresh_cache-9b4783e1-34e3-425c-87c3-ee8bda2c6853" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquired lock "refresh_cache-9b4783e1-34e3-425c-87c3-ee8bda2c6853" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG nova.network.neutron [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Received event network-changed-ad8cf137-9750-4de8-8c9e-1fca491a3348 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Refreshing instance network info cache due to event network-changed-ad8cf137-9750-4de8-8c9e-1fca491a3348. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] Acquiring lock "refresh_cache-9b4783e1-34e3-425c-87c3-ee8bda2c6853" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:46:21 user nova-compute[71711]: DEBUG nova.network.neutron [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.network.neutron [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Updating instance_info_cache with network_info: [{"id": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "address": "fa:16:3e:47:da:87", "network": {"id": "1006f4e0-e12c-47c3-8455-c2f9778b12a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d17c81157dc240a396f20e397d55ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8cf137-97", "ovs_interfaceid": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Releasing lock "refresh_cache-9b4783e1-34e3-425c-87c3-ee8bda2c6853" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Instance network_info: |[{"id": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "address": "fa:16:3e:47:da:87", "network": {"id": "1006f4e0-e12c-47c3-8455-c2f9778b12a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d17c81157dc240a396f20e397d55ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8cf137-97", "ovs_interfaceid": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] Acquired lock "refresh_cache-9b4783e1-34e3-425c-87c3-ee8bda2c6853" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.network.neutron [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Refreshing network info cache for port ad8cf137-9750-4de8-8c9e-1fca491a3348 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Start _get_guest_xml network_info=[{"id": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "address": "fa:16:3e:47:da:87", "network": {"id": "1006f4e0-e12c-47c3-8455-c2f9778b12a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d17c81157dc240a396f20e397d55ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8cf137-97", "ovs_interfaceid": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:46:22 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:46:22 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1603035936',display_name='tempest-VolumesNegativeTest-instance-1603035936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1603035936',id=37,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5098984b6bda4c2d9a71023292e7815c',ramdisk_id='',reservation_id='r-ky8swxpt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-289347363',owner_user_name='tempest-VolumesNegativeTest-289347363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:46:20Z,user_data=None,user_id='c93cca7970df482f8c3a00f15ef12fde',uuid=9b4783e1-34e3-425c-87c3-ee8bda2c6853,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "address": "fa:16:3e:47:da:87", "network": {"id": "1006f4e0-e12c-47c3-8455-c2f9778b12a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d17c81157dc240a396f20e397d55ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8cf137-97", "ovs_interfaceid": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Converting VIF {"id": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "address": "fa:16:3e:47:da:87", "network": {"id": "1006f4e0-e12c-47c3-8455-c2f9778b12a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d17c81157dc240a396f20e397d55ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8cf137-97", "ovs_interfaceid": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:da:87,bridge_name='br-int',has_traffic_filtering=True,id=ad8cf137-9750-4de8-8c9e-1fca491a3348,network=Network(1006f4e0-e12c-47c3-8455-c2f9778b12a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8cf137-97') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.objects.instance [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b4783e1-34e3-425c-87c3-ee8bda2c6853 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:46:22 user nova-compute[71711]:   <uuid>9b4783e1-34e3-425c-87c3-ee8bda2c6853</uuid>
Apr 12 06:46:22 user nova-compute[71711]:   <name>instance-00000025</name>
Apr 12 06:46:22 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:46:22 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:46:22 user nova-compute[71711]:   <metadata>
Apr 12 06:46:22 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:46:22 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:46:22 user nova-compute[71711]:       <nova:name>tempest-VolumesNegativeTest-instance-1603035936</nova:name>
Apr 12 06:46:22 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:46:22</nova:creationTime>
Apr 12 06:46:22 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:46:22 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:46:22 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:46:22 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:46:22 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:46:22 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:46:22 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:46:22 user nova-compute[71711]:       <nova:owner>
Apr 12 06:46:22 user nova-compute[71711]:         <nova:user uuid="c93cca7970df482f8c3a00f15ef12fde">tempest-VolumesNegativeTest-289347363-project-member</nova:user>
Apr 12 06:46:22 user nova-compute[71711]:         <nova:project uuid="5098984b6bda4c2d9a71023292e7815c">tempest-VolumesNegativeTest-289347363</nova:project>
Apr 12 06:46:22 user nova-compute[71711]:       </nova:owner>
Apr 12 06:46:22 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:46:22 user nova-compute[71711]:       <nova:ports>
Apr 12 06:46:22 user nova-compute[71711]:         <nova:port uuid="ad8cf137-9750-4de8-8c9e-1fca491a3348">
Apr 12 06:46:22 user nova-compute[71711]:           <nova:ip type="fixed" address="192.168.233.197" ipVersion="4"/>
Apr 12 06:46:22 user nova-compute[71711]:         </nova:port>
Apr 12 06:46:22 user nova-compute[71711]:       </nova:ports>
Apr 12 06:46:22 user nova-compute[71711]:     </nova:instance>
Apr 12 06:46:22 user nova-compute[71711]:   </metadata>
Apr 12 06:46:22 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:46:22 user nova-compute[71711]:     <system>
Apr 12 06:46:22 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:46:22 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:46:22 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:46:22 user nova-compute[71711]:       <entry name="serial">9b4783e1-34e3-425c-87c3-ee8bda2c6853</entry>
Apr 12 06:46:22 user nova-compute[71711]:       <entry name="uuid">9b4783e1-34e3-425c-87c3-ee8bda2c6853</entry>
Apr 12 06:46:22 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:46:22 user nova-compute[71711]:     </system>
Apr 12 06:46:22 user nova-compute[71711]:   </sysinfo>
Apr 12 06:46:22 user nova-compute[71711]:   <os>
Apr 12 06:46:22 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:46:22 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:46:22 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:46:22 user nova-compute[71711]:   </os>
Apr 12 06:46:22 user nova-compute[71711]:   <features>
Apr 12 06:46:22 user nova-compute[71711]:     <acpi/>
Apr 12 06:46:22 user nova-compute[71711]:     <apic/>
Apr 12 06:46:22 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:46:22 user nova-compute[71711]:   </features>
Apr 12 06:46:22 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:46:22 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:46:22 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:46:22 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:46:22 user nova-compute[71711]:   </clock>
Apr 12 06:46:22 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:46:22 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:46:22 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:46:22 user nova-compute[71711]:   </cpu>
Apr 12 06:46:22 user nova-compute[71711]:   <devices>
Apr 12 06:46:22 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:46:22 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:46:22 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk"/>
Apr 12 06:46:22 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:46:22 user nova-compute[71711]:     </disk>
Apr 12 06:46:22 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:46:22 user nova-compute[71711]:       <mac address="fa:16:3e:47:da:87"/>
Apr 12 06:46:22 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:46:22 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:46:22 user nova-compute[71711]:       <target dev="tapad8cf137-97"/>
Apr 12 06:46:22 user nova-compute[71711]:     </interface>
Apr 12 06:46:22 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:46:22 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/console.log" append="off"/>
Apr 12 06:46:22 user nova-compute[71711]:     </serial>
Apr 12 06:46:22 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:46:22 user nova-compute[71711]:     <video>
Apr 12 06:46:22 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:46:22 user nova-compute[71711]:     </video>
Apr 12 06:46:22 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:46:22 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:46:22 user nova-compute[71711]:     </rng>
Apr 12 06:46:22 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:46:22 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:46:22 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:46:22 user nova-compute[71711]:     </memballoon>
Apr 12 06:46:22 user nova-compute[71711]:   </devices>
Apr 12 06:46:22 user nova-compute[71711]: </domain>
Apr 12 06:46:22 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1603035936',display_name='tempest-VolumesNegativeTest-instance-1603035936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1603035936',id=37,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5098984b6bda4c2d9a71023292e7815c',ramdisk_id='',reservation_id='r-ky8swxpt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-289347363',owner_user_name='tempest-VolumesNegativeTest-289347363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:46:20Z,user_data=None,user_id='c93cca7970df482f8c3a00f15ef12fde',uuid=9b4783e1-34e3-425c-87c3-ee8bda2c6853,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "address": "fa:16:3e:47:da:87", "network": {"id": "1006f4e0-e12c-47c3-8455-c2f9778b12a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d17c81157dc240a396f20e397d55ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8cf137-97", "ovs_interfaceid": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Converting VIF {"id": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "address": "fa:16:3e:47:da:87", "network": {"id": "1006f4e0-e12c-47c3-8455-c2f9778b12a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d17c81157dc240a396f20e397d55ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8cf137-97", "ovs_interfaceid": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:da:87,bridge_name='br-int',has_traffic_filtering=True,id=ad8cf137-9750-4de8-8c9e-1fca491a3348,network=Network(1006f4e0-e12c-47c3-8455-c2f9778b12a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8cf137-97') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG os_vif [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:da:87,bridge_name='br-int',has_traffic_filtering=True,id=ad8cf137-9750-4de8-8c9e-1fca491a3348,network=Network(1006f4e0-e12c-47c3-8455-c2f9778b12a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8cf137-97') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad8cf137-97, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad8cf137-97, col_values=(('external_ids', {'iface-id': 'ad8cf137-9750-4de8-8c9e-1fca491a3348', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:da:87', 'vm-uuid': '9b4783e1-34e3-425c-87c3-ee8bda2c6853'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:22 user nova-compute[71711]: INFO os_vif [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:da:87,bridge_name='br-int',has_traffic_filtering=True,id=ad8cf137-9750-4de8-8c9e-1fca491a3348,network=Network(1006f4e0-e12c-47c3-8455-c2f9778b12a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8cf137-97')
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] No VIF found with MAC fa:16:3e:47:da:87, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.network.neutron [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Updated VIF entry in instance network info cache for port ad8cf137-9750-4de8-8c9e-1fca491a3348. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG nova.network.neutron [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Updating instance_info_cache with network_info: [{"id": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "address": "fa:16:3e:47:da:87", "network": {"id": "1006f4e0-e12c-47c3-8455-c2f9778b12a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d17c81157dc240a396f20e397d55ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8cf137-97", "ovs_interfaceid": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:46:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-477a84a0-61a7-468d-8642-592735ae323c req-1ac1c074-62d9-45b3-b4d8-74fd55644e82 service nova] Releasing lock "refresh_cache-9b4783e1-34e3-425c-87c3-ee8bda2c6853" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:46:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-f82d63e6-4e57-4af0-a4bd-8041a0169931 req-bcc545dd-3b5d-4c91-a263-0eb71b2c23d0 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Received event network-vif-plugged-ad8cf137-9750-4de8-8c9e-1fca491a3348 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:46:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f82d63e6-4e57-4af0-a4bd-8041a0169931 req-bcc545dd-3b5d-4c91-a263-0eb71b2c23d0 service nova] Acquiring lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f82d63e6-4e57-4af0-a4bd-8041a0169931 req-bcc545dd-3b5d-4c91-a263-0eb71b2c23d0 service nova] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f82d63e6-4e57-4af0-a4bd-8041a0169931 req-bcc545dd-3b5d-4c91-a263-0eb71b2c23d0 service nova] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-f82d63e6-4e57-4af0-a4bd-8041a0169931 req-bcc545dd-3b5d-4c91-a263-0eb71b2c23d0 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] No waiting events found dispatching network-vif-plugged-ad8cf137-9750-4de8-8c9e-1fca491a3348 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:46:23 user nova-compute[71711]: WARNING nova.compute.manager [req-f82d63e6-4e57-4af0-a4bd-8041a0169931 req-bcc545dd-3b5d-4c91-a263-0eb71b2c23d0 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Received unexpected event network-vif-plugged-ad8cf137-9750-4de8-8c9e-1fca491a3348 for instance with vm_state building and task_state spawning.
Apr 12 06:46:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-4a9ef645-dd39-4a8f-9932-6e83d1e0703c req-f67c0ad7-10c3-4b40-b6cd-fec3c58a3d72 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Received event network-vif-plugged-ad8cf137-9750-4de8-8c9e-1fca491a3348 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:46:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4a9ef645-dd39-4a8f-9932-6e83d1e0703c req-f67c0ad7-10c3-4b40-b6cd-fec3c58a3d72 service nova] Acquiring lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4a9ef645-dd39-4a8f-9932-6e83d1e0703c req-f67c0ad7-10c3-4b40-b6cd-fec3c58a3d72 service nova] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-4a9ef645-dd39-4a8f-9932-6e83d1e0703c req-f67c0ad7-10c3-4b40-b6cd-fec3c58a3d72 service nova] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-4a9ef645-dd39-4a8f-9932-6e83d1e0703c req-f67c0ad7-10c3-4b40-b6cd-fec3c58a3d72 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] No waiting events found dispatching network-vif-plugged-ad8cf137-9750-4de8-8c9e-1fca491a3348 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:46:25 user nova-compute[71711]: WARNING nova.compute.manager [req-4a9ef645-dd39-4a8f-9932-6e83d1e0703c req-f67c0ad7-10c3-4b40-b6cd-fec3c58a3d72 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Received unexpected event network-vif-plugged-ad8cf137-9750-4de8-8c9e-1fca491a3348 for instance with vm_state building and task_state spawning.
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281986.306034, 9b4783e1-34e3-425c-87c3-ee8bda2c6853 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:46:26 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] VM Resumed (Lifecycle Event)
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:46:26 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Instance spawned successfully.
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:46:26 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681281986.307324, 9b4783e1-34e3-425c-87c3-ee8bda2c6853 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:46:26 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] VM Started (Lifecycle Event)
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:46:26 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:46:26 user nova-compute[71711]: INFO nova.compute.manager [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Took 6.01 seconds to spawn the instance on the hypervisor.
Apr 12 06:46:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:46:26 user nova-compute[71711]: INFO nova.compute.manager [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Took 6.53 seconds to build instance.
Apr 12 06:46:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8053db52-7391-4338-9562-77361b1bf666 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.635s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "02209375-f25a-4d51-9828-3422144c2ed8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:46:43 user nova-compute[71711]: INFO nova.compute.claims [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Claim successful on node user
Apr 12 06:46:43 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:46:43 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:46:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG nova.policy [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:46:43 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Creating image(s)
Apr 12 06:46:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "/opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "/opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "/opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:43 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.146s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.154s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk 1073741824" returned: 0 in 0.056s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.163s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Cannot resize image /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG nova.objects.instance [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'migration_context' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Ensure instance console log exists: /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:44 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Successfully created port: e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Successfully updated port: e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquired lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.compute.manager [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-changed-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.compute.manager [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Refreshing instance network info cache due to event network-changed-e6c75186-26c0-414f-9dfe-13cb03283057. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] Acquiring lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updating instance_info_cache with network_info: [{"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Releasing lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Instance network_info: |[{"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] Acquired lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.network.neutron [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Refreshing network info cache for port e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Start _get_guest_xml network_info=[{"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:46:45 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:46:45 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2020171009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2020171009',id=38,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZegZIYK1I87WzI/GopP0gFDiVIk2m3tD+Xr8CMKYFLScduowkDoSCdMQjYZBkxgp/FVmCcjJUpm9/3fq/7gj6jh4/k43FpV6VBh16G/3bTDxKZLcvBw9dpNKFRqAyABQ==',key_name='tempest-keypair-914952928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76a8460ce5c24d1db20e80a1659133f7',ramdisk_id='',reservation_id='r-5iy62es8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1986658224',owner_user_name='tempest-AttachVolumeShelveTestJSON-1986658224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fbb8c37e5a74a0b83011c2a21033204',uuid=02209375-f25a-4d51-9828-3422144c2ed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converting VIF {"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.objects.instance [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'pci_devices' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:46:45 user nova-compute[71711]:   <uuid>02209375-f25a-4d51-9828-3422144c2ed8</uuid>
Apr 12 06:46:45 user nova-compute[71711]:   <name>instance-00000026</name>
Apr 12 06:46:45 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:46:45 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:46:45 user nova-compute[71711]:   <metadata>
Apr 12 06:46:45 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:46:45 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:46:45 user nova-compute[71711]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2020171009</nova:name>
Apr 12 06:46:45 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:46:45</nova:creationTime>
Apr 12 06:46:45 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:46:45 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:46:45 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:46:45 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:46:45 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:46:45 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:46:45 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:46:45 user nova-compute[71711]:       <nova:owner>
Apr 12 06:46:45 user nova-compute[71711]:         <nova:user uuid="4fbb8c37e5a74a0b83011c2a21033204">tempest-AttachVolumeShelveTestJSON-1986658224-project-member</nova:user>
Apr 12 06:46:45 user nova-compute[71711]:         <nova:project uuid="76a8460ce5c24d1db20e80a1659133f7">tempest-AttachVolumeShelveTestJSON-1986658224</nova:project>
Apr 12 06:46:45 user nova-compute[71711]:       </nova:owner>
Apr 12 06:46:45 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:46:45 user nova-compute[71711]:       <nova:ports>
Apr 12 06:46:45 user nova-compute[71711]:         <nova:port uuid="e6c75186-26c0-414f-9dfe-13cb03283057">
Apr 12 06:46:45 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:46:45 user nova-compute[71711]:         </nova:port>
Apr 12 06:46:45 user nova-compute[71711]:       </nova:ports>
Apr 12 06:46:45 user nova-compute[71711]:     </nova:instance>
Apr 12 06:46:45 user nova-compute[71711]:   </metadata>
Apr 12 06:46:45 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:46:45 user nova-compute[71711]:     <system>
Apr 12 06:46:45 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:46:45 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:46:45 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:46:45 user nova-compute[71711]:       <entry name="serial">02209375-f25a-4d51-9828-3422144c2ed8</entry>
Apr 12 06:46:45 user nova-compute[71711]:       <entry name="uuid">02209375-f25a-4d51-9828-3422144c2ed8</entry>
Apr 12 06:46:45 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:46:45 user nova-compute[71711]:     </system>
Apr 12 06:46:45 user nova-compute[71711]:   </sysinfo>
Apr 12 06:46:45 user nova-compute[71711]:   <os>
Apr 12 06:46:45 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:46:45 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:46:45 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:46:45 user nova-compute[71711]:   </os>
Apr 12 06:46:45 user nova-compute[71711]:   <features>
Apr 12 06:46:45 user nova-compute[71711]:     <acpi/>
Apr 12 06:46:45 user nova-compute[71711]:     <apic/>
Apr 12 06:46:45 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:46:45 user nova-compute[71711]:   </features>
Apr 12 06:46:45 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:46:45 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:46:45 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:46:45 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:46:45 user nova-compute[71711]:   </clock>
Apr 12 06:46:45 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:46:45 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:46:45 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:46:45 user nova-compute[71711]:   </cpu>
Apr 12 06:46:45 user nova-compute[71711]:   <devices>
Apr 12 06:46:45 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:46:45 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:46:45 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk"/>
Apr 12 06:46:45 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:46:45 user nova-compute[71711]:     </disk>
Apr 12 06:46:45 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:46:45 user nova-compute[71711]:       <mac address="fa:16:3e:03:ee:ad"/>
Apr 12 06:46:45 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:46:45 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:46:45 user nova-compute[71711]:       <target dev="tape6c75186-26"/>
Apr 12 06:46:45 user nova-compute[71711]:     </interface>
Apr 12 06:46:45 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:46:45 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/console.log" append="off"/>
Apr 12 06:46:45 user nova-compute[71711]:     </serial>
Apr 12 06:46:45 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:46:45 user nova-compute[71711]:     <video>
Apr 12 06:46:45 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:46:45 user nova-compute[71711]:     </video>
Apr 12 06:46:45 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:46:45 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:46:45 user nova-compute[71711]:     </rng>
Apr 12 06:46:45 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:46:45 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:46:45 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:46:45 user nova-compute[71711]:     </memballoon>
Apr 12 06:46:45 user nova-compute[71711]:   </devices>
Apr 12 06:46:45 user nova-compute[71711]: </domain>
Apr 12 06:46:45 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2020171009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2020171009',id=38,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZegZIYK1I87WzI/GopP0gFDiVIk2m3tD+Xr8CMKYFLScduowkDoSCdMQjYZBkxgp/FVmCcjJUpm9/3fq/7gj6jh4/k43FpV6VBh16G/3bTDxKZLcvBw9dpNKFRqAyABQ==',key_name='tempest-keypair-914952928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76a8460ce5c24d1db20e80a1659133f7',ramdisk_id='',reservation_id='r-5iy62es8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1986658224',owner_user_name='tempest-AttachVolumeShelveTestJSON-1986658224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fbb8c37e5a74a0b83011c2a21033204',uuid=02209375-f25a-4d51-9828-3422144c2ed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converting VIF {"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG os_vif [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6c75186-26, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6c75186-26, col_values=(('external_ids', {'iface-id': 'e6c75186-26c0-414f-9dfe-13cb03283057', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:ee:ad', 'vm-uuid': '02209375-f25a-4d51-9828-3422144c2ed8'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:45 user nova-compute[71711]: INFO os_vif [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26')
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:46:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] No VIF found with MAC fa:16:3e:03:ee:ad, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:46:46 user nova-compute[71711]: DEBUG nova.network.neutron [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updated VIF entry in instance network info cache for port e6c75186-26c0-414f-9dfe-13cb03283057. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:46:46 user nova-compute[71711]: DEBUG nova.network.neutron [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updating instance_info_cache with network_info: [{"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:46:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fe62c090-6d4d-450f-8857-741d8efaebf6 req-a7aba402-5d0f-4d4d-b7c6-dfb64b941ac2 service nova] Releasing lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:46:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:47 user nova-compute[71711]: DEBUG nova.compute.manager [req-36e4a341-6868-4e28-b970-47c7e52b5387 req-588e4387-450d-4719-9abe-789f212951ea service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:46:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-36e4a341-6868-4e28-b970-47c7e52b5387 req-588e4387-450d-4719-9abe-789f212951ea service nova] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-36e4a341-6868-4e28-b970-47c7e52b5387 req-588e4387-450d-4719-9abe-789f212951ea service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-36e4a341-6868-4e28-b970-47c7e52b5387 req-588e4387-450d-4719-9abe-789f212951ea service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:47 user nova-compute[71711]: DEBUG nova.compute.manager [req-36e4a341-6868-4e28-b970-47c7e52b5387 req-588e4387-450d-4719-9abe-789f212951ea service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] No waiting events found dispatching network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:46:47 user nova-compute[71711]: WARNING nova.compute.manager [req-36e4a341-6868-4e28-b970-47c7e52b5387 req-588e4387-450d-4719-9abe-789f212951ea service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received unexpected event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 for instance with vm_state building and task_state spawning.
Apr 12 06:46:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-090523f1-52b7-4074-a2ac-3c78326ebe2d req-c4971133-829f-403b-8e29-378955498ac0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-090523f1-52b7-4074-a2ac-3c78326ebe2d req-c4971133-829f-403b-8e29-378955498ac0 service nova] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-090523f1-52b7-4074-a2ac-3c78326ebe2d req-c4971133-829f-403b-8e29-378955498ac0 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-090523f1-52b7-4074-a2ac-3c78326ebe2d req-c4971133-829f-403b-8e29-378955498ac0 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-090523f1-52b7-4074-a2ac-3c78326ebe2d req-c4971133-829f-403b-8e29-378955498ac0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] No waiting events found dispatching network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:46:49 user nova-compute[71711]: WARNING nova.compute.manager [req-090523f1-52b7-4074-a2ac-3c78326ebe2d req-c4971133-829f-403b-8e29-378955498ac0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received unexpected event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 for instance with vm_state building and task_state spawning.
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282009.590969, 02209375-f25a-4d51-9828-3422144c2ed8 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:46:49 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] VM Resumed (Lifecycle Event)
Apr 12 06:46:49 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Instance spawned successfully.
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:46:49 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282009.5911434, 02209375-f25a-4d51-9828-3422144c2ed8 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:46:49 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] VM Started (Lifecycle Event)
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:46:49 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:46:49 user nova-compute[71711]: INFO nova.compute.manager [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Took 5.81 seconds to spawn the instance on the hypervisor.
Apr 12 06:46:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:46:49 user nova-compute[71711]: INFO nova.compute.manager [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Took 6.37 seconds to build instance.
Apr 12 06:46:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5e28aed3-b9e4-460b-8583-e5f81ddae18b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "02209375-f25a-4d51-9828-3422144c2ed8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.472s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:46:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:46:55 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:46:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:01 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:47:02 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:47:02 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:47:03 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:47:03 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:47:04 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:47:04 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:47:04 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:47:04 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:47:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-20f055ae-909d-4fda-a2d5-0f4aef77928e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:47:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-20f055ae-909d-4fda-a2d5-0f4aef77928e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:47:04 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:47:04 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid 20f055ae-909d-4fda-a2d5-0f4aef77928e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:47:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:05 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Updating instance_info_cache with network_info: [{"id": "2923dc36-c11b-43e4-afed-fb46cc033110", "address": "fa:16:3e:8f:d5:67", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2923dc36-c1", "ovs_interfaceid": "2923dc36-c11b-43e4-afed-fb46cc033110", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:47:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-20f055ae-909d-4fda-a2d5-0f4aef77928e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:47:05 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:47:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:47:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:07 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:47:07 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:47:07 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8478MB free_disk=26.21938705444336GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:47:07 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:07 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:07 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 20f055ae-909d-4fda-a2d5-0f4aef77928e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:47:07 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:47:07 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 02209375-f25a-4d51-9828-3422144c2ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:47:07 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:47:07 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:47:07 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:47:07 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:47:07 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:47:07 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:11 user nova-compute[71711]: DEBUG nova.objects.instance [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'flavor' on Instance uuid 20f055ae-909d-4fda-a2d5-0f4aef77928e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:47:11 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Ignoring supplied device name: /dev/vdb
Apr 12 06:47:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:12 user nova-compute[71711]: INFO nova.compute.manager [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Attaching volume 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 to /dev/vdb
Apr 12 06:47:12 user nova-compute[71711]: DEBUG os_brick.utils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[78008a01-ecc2-4305-ba4a-8f049b063b4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1ad03d-d96d-479c-9048-b12ec2907c8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[be535546-4bc6-4b33-be9f-809bc409a0e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1b9758-4066-4934-8cee-f92e8d1e8243]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:47:12 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:47:12 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aeb4ee-dc2d-4645-bd1f-9d88de558faf]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG os_brick.utils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:47:12 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Updating existing volume attachment record: ff4523fc-5bea-495f-b3e4-f8d215954385 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:47:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zodFkufL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:47:16 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:47:16 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:47:16 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260" returned: 21 in 0.114s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b9e432-cd97-4671-a655-5aa9a52aaaec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:47:16 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ace185-992c-4da9-b400-2f80119e3d0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0] added
Apr 12 06:47:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.083s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[648080c5-0164-4a56-9b47-8d0714d4e212]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9c8d3d-eef9-4e7f-8c26-d6218de89fb5]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zodFkufL {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zodFkufL" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd10cb12-c6f6-4d8b-8807-861a50f3338c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zodFkufL'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e98e36f-f515-4230-9583-624c10aaa1a9]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[352cdff5-c877-406c-a650-9a28fb6c18fe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:47:16 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:47:16 user nova-compute[71711]:  {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:47:16 user nova-compute[71711]: WARNING os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 06:47:16 user nova-compute[71711]: 
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[65351d8c-4472-4883-8c6f-327fbb0f5e2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0, portal: 172.16.0.220,3260]
Apr 12 06:47:16 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0, portal: 172.16.0.220,3260] successful.
Apr 12 06:47:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[086320b0-f32f-4730-bc23-72e904b3fd0a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6429b8-575b-4ab5-8ea9-eba9348ecbb8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 (non-flash)
Apr 12 06:47:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 (non-flash)
Apr 12 06:47:16 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e751aa-602f-4786-8beb-692ef8282bdf]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:47:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zodFkufL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:47:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:47:17 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23535656430653363', 'path': '/dev/sdb'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:47:17 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535656430653363', 'path': '/dev/sdb'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:47:17 user nova-compute[71711]: DEBUG nova.objects.instance [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'flavor' on Instance uuid 20f055ae-909d-4fda-a2d5-0f4aef77928e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:47:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:47:18 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:47:18 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:47:18 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:47:18 user nova-compute[71711]:   <serial>1a3b8849-fc77-4b4a-858e-5eb6bd4612d0</serial>
Apr 12 06:47:18 user nova-compute[71711]: </disk>
Apr 12 06:47:18 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:47:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:47:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:47:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] No VIF found with MAC fa:16:3e:8f:d5:67, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:47:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9c0a9c2e-f8df-4095-96e9-40a7b4accb9d tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.467s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:29 user nova-compute[71711]: INFO nova.compute.manager [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Detaching volume 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0
Apr 12 06:47:29 user nova-compute[71711]: INFO nova.virt.block_device [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Attempting to driver detach volume 1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 from mountpoint /dev/vdb
Apr 12 06:47:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Attempting to detach device vdb from instance 20f055ae-909d-4fda-a2d5-0f4aef77928e from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:47:29 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:47:29 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:47:29 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:47:29 user nova-compute[71711]:   <serial>1a3b8849-fc77-4b4a-858e-5eb6bd4612d0</serial>
Apr 12 06:47:29 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:47:29 user nova-compute[71711]: </disk>
Apr 12 06:47:29 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:47:29 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Successfully detached device vdb from instance 20f055ae-909d-4fda-a2d5-0f4aef77928e from the persistent domain config.
Apr 12 06:47:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 20f055ae-909d-4fda-a2d5-0f4aef77928e from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:47:29 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:47:29 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:47:29 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:47:29 user nova-compute[71711]:   <serial>1a3b8849-fc77-4b4a-858e-5eb6bd4612d0</serial>
Apr 12 06:47:29 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:47:29 user nova-compute[71711]: </disk>
Apr 12 06:47:29 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681282049.6449866, 20f055ae-909d-4fda-a2d5-0f4aef77928e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 20f055ae-909d-4fda-a2d5-0f4aef77928e {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:47:29 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Successfully detached device vdb from instance 20f055ae-909d-4fda-a2d5-0f4aef77928e from the live domain config.
Apr 12 06:47:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zodFkufL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:47:29 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.044s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7a0ce9-6920-4cdf-b679-8b156c88efd0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:47:29 user nova-compute[71711]: No targets found.
Apr 12 06:47:29 user nova-compute[71711]: iSNS:
Apr 12 06:47:29 user nova-compute[71711]: No targets found.
Apr 12 06:47:29 user nova-compute[71711]: STATIC:
Apr 12 06:47:29 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0
Apr 12 06:47:29 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:47:29 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:47:29 user nova-compute[71711]: FIRMWARE:
Apr 12 06:47:29 user nova-compute[71711]: No targets found.
Apr 12 06:47:29 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:47:29 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:47:29 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f8513e-b62d-42b5-a6d9-4ec47c449a37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c9794a-7adc-41c9-a504-3abbacfbb688]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 (non-flash)
Apr 12 06:47:29 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 (non-flash)
Apr 12 06:47:29 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9961ea9ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0'): ({'sdb'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Removing single pathed devices sdb {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c260f5-d19d-41d5-a8bf-f7881866cf2a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afb0994-342b-439e-bd03-90428dc5ce12]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Flushing IO for device /dev/sdb {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a9eac3-c37e-4112-9dc4-448bc6c806a5]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[02012ef6-9d0b-464f-836d-a4ebd28451b9]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a22c5ac-df6e-41b4-854f-b593af7979e4]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b09b37b-8731-4fb7-bd7b-a028ba33b0c7]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0, portal: 172.16.0.220,3260]
Apr 12 06:47:29 user nova-compute[71711]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0, portal: 172.16.0.220,3260] successful.
Apr 12 06:47:29 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eab2f8-cd52-4132-b51e-4090d98bdfdd]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] <== disconnect_volume: return (338ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:47:29 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:47:30 user nova-compute[71711]: DEBUG nova.objects.instance [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'flavor' on Instance uuid 20f055ae-909d-4fda-a2d5-0f4aef77928e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:47:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-78979514-82af-48bc-af84-1e6996d54551 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.745s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.595s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:30 user nova-compute[71711]: INFO nova.compute.manager [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Terminating instance
Apr 12 06:47:30 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:47:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG nova.compute.manager [req-c1bb0c69-f545-4825-b57b-3d543a8ab249 req-96192035-7157-4667-8b89-8db43cf269e9 service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Received event network-vif-unplugged-2923dc36-c11b-43e4-afed-fb46cc033110 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c1bb0c69-f545-4825-b57b-3d543a8ab249 req-96192035-7157-4667-8b89-8db43cf269e9 service nova] Acquiring lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c1bb0c69-f545-4825-b57b-3d543a8ab249 req-96192035-7157-4667-8b89-8db43cf269e9 service nova] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c1bb0c69-f545-4825-b57b-3d543a8ab249 req-96192035-7157-4667-8b89-8db43cf269e9 service nova] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG nova.compute.manager [req-c1bb0c69-f545-4825-b57b-3d543a8ab249 req-96192035-7157-4667-8b89-8db43cf269e9 service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] No waiting events found dispatching network-vif-unplugged-2923dc36-c11b-43e4-afed-fb46cc033110 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG nova.compute.manager [req-c1bb0c69-f545-4825-b57b-3d543a8ab249 req-96192035-7157-4667-8b89-8db43cf269e9 service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Received event network-vif-unplugged-2923dc36-c11b-43e4-afed-fb46cc033110 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:31 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Instance destroyed successfully.
Apr 12 06:47:31 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lazy-loading 'resources' on Instance uuid 20f055ae-909d-4fda-a2d5-0f4aef77928e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1542125927',display_name='tempest-VolumesSnapshotTestJSON-instance-1542125927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1542125927',id=36,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:45:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af34529636fc4221921028f93b1c381a',ramdisk_id='',reservation_id='r-wwxvhzdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2015355536',owner_user_name='tempest-VolumesSnapshotTestJSON-2015355536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:45:28Z,user_data=None,user_id='8546fd1ed08b4e88a945e73347be38c2',uuid=20f055ae-909d-4fda-a2d5-0f4aef77928e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2923dc36-c11b-43e4-afed-fb46cc033110", "address": "fa:16:3e:8f:d5:67", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2923dc36-c1", "ovs_interfaceid": "2923dc36-c11b-43e4-afed-fb46cc033110", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Converting VIF {"id": "2923dc36-c11b-43e4-afed-fb46cc033110", "address": "fa:16:3e:8f:d5:67", "network": {"id": "c85a8ae1-c736-4edc-ba2d-0a71237adc9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-664855321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "af34529636fc4221921028f93b1c381a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2923dc36-c1", "ovs_interfaceid": "2923dc36-c11b-43e4-afed-fb46cc033110", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2923dc36-c11b-43e4-afed-fb46cc033110,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2923dc36-c1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG os_vif [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2923dc36-c11b-43e4-afed-fb46cc033110,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2923dc36-c1') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2923dc36-c1, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:31 user nova-compute[71711]: INFO os_vif [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:d5:67,bridge_name='br-int',has_traffic_filtering=True,id=2923dc36-c11b-43e4-afed-fb46cc033110,network=Network(c85a8ae1-c736-4edc-ba2d-0a71237adc9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2923dc36-c1')
Apr 12 06:47:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:1a3b8849-fc77-4b4a-858e-5eb6bd4612d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zodFkufL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:47:31 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:47:31 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[6fd5e1a0-d328-442c-a0d6-88540afdcb6a]: Unexpected error while running command.
Apr 12 06:47:31 user nova-compute[71711]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 06:47:31 user nova-compute[71711]: Exit code: 21
Apr 12 06:47:31 user nova-compute[71711]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 06:47:31 user nova-compute[71711]: Stderr: '' {{(pid=81777) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 12 06:47:31 user nova-compute[71711]: Traceback (most recent call last):
Apr 12 06:47:31 user nova-compute[71711]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 12 06:47:31 user nova-compute[71711]:     ret = func(*f_args, **f_kwargs)
Apr 12 06:47:31 user nova-compute[71711]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 12 06:47:31 user nova-compute[71711]:     return func(*args, **kwargs)
Apr 12 06:47:31 user nova-compute[71711]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 12 06:47:31 user nova-compute[71711]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 12 06:47:31 user nova-compute[71711]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 12 06:47:31 user nova-compute[71711]:     return putils.execute(on_execute=on_execute,
Apr 12 06:47:31 user nova-compute[71711]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 12 06:47:31 user nova-compute[71711]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 12 06:47:31 user nova-compute[71711]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 12 06:47:31 user nova-compute[71711]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 06:47:31 user nova-compute[71711]: Exit code: 21
Apr 12 06:47:31 user nova-compute[71711]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 06:47:31 user nova-compute[71711]: Stderr: ''
Apr 12 06:47:31 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd5e1a0-d328-442c-a0d6-88540afdcb6a]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 12 06:47:31 user nova-compute[71711]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 06:47:31 user nova-compute[71711]: Exit code: 21
Apr 12 06:47:31 user nova-compute[71711]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 06:47:31 user nova-compute[71711]: Stderr: ''
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 12 06:47:31 user nova-compute[71711]: ERROR os_brick.initiator.connectors.iscsi 
Apr 12 06:47:31 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71711) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.036s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] <== disconnect_volume: return (37ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:47:31 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Deleting instance files /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e_del
Apr 12 06:47:31 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Deletion of /opt/stack/data/nova/instances/20f055ae-909d-4fda-a2d5-0f4aef77928e_del complete
Apr 12 06:47:31 user nova-compute[71711]: INFO nova.compute.manager [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 12 06:47:31 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:47:31 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:47:32 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:47:32 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Took 0.43 seconds to deallocate network for instance.
Apr 12 06:47:32 user nova-compute[71711]: DEBUG nova.compute.manager [req-101c2916-94a2-4604-acaa-1e9cea5b3d6c req-31222117-111b-4aa8-9dbd-9b072cecc4ff service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Received event network-vif-deleted-2923dc36-c11b-43e4-afed-fb46cc033110 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:47:32 user nova-compute[71711]: WARNING nova.volume.cinder [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Attachment ff4523fc-5bea-495f-b3e4-f8d215954385 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ff4523fc-5bea-495f-b3e4-f8d215954385. (HTTP 404) (Request-ID: req-1a298ff6-2490-4c18-b4ae-32e368e516a2)
Apr 12 06:47:32 user nova-compute[71711]: INFO nova.compute.manager [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Took 0.03 seconds to detach 1 volumes for instance.
Apr 12 06:47:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:32 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:47:32 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:47:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:32 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Deleted allocations for instance 20f055ae-909d-4fda-a2d5-0f4aef77928e
Apr 12 06:47:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a55cfd78-6035-4648-a72c-22b696c150e8 tempest-VolumesSnapshotTestJSON-2015355536 tempest-VolumesSnapshotTestJSON-2015355536-project-member] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.708s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-c129877f-00d2-4eb1-b803-2c7daea74741 req-90f4d40c-e624-4a22-ac19-b074dad81f50 service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Received event network-vif-plugged-2923dc36-c11b-43e4-afed-fb46cc033110 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:47:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c129877f-00d2-4eb1-b803-2c7daea74741 req-90f4d40c-e624-4a22-ac19-b074dad81f50 service nova] Acquiring lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c129877f-00d2-4eb1-b803-2c7daea74741 req-90f4d40c-e624-4a22-ac19-b074dad81f50 service nova] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c129877f-00d2-4eb1-b803-2c7daea74741 req-90f4d40c-e624-4a22-ac19-b074dad81f50 service nova] Lock "20f055ae-909d-4fda-a2d5-0f4aef77928e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-c129877f-00d2-4eb1-b803-2c7daea74741 req-90f4d40c-e624-4a22-ac19-b074dad81f50 service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] No waiting events found dispatching network-vif-plugged-2923dc36-c11b-43e4-afed-fb46cc033110 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:47:33 user nova-compute[71711]: WARNING nova.compute.manager [req-c129877f-00d2-4eb1-b803-2c7daea74741 req-90f4d40c-e624-4a22-ac19-b074dad81f50 service nova] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Received unexpected event network-vif-plugged-2923dc36-c11b-43e4-afed-fb46cc033110 for instance with vm_state deleted and task_state None.
Apr 12 06:47:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:39 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:47:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:47:39 user nova-compute[71711]: INFO nova.compute.claims [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Claim successful on node user
Apr 12 06:47:39 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:47:39 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:47:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:39 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:47:40 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:47:40 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG nova.policy [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:47:40 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Creating image(s)
Apr 12 06:47:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "/opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "/opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "cef3c22c9889719523c9c6bb8c95560451adb22a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "cef3c22c9889719523c9c6bb8c95560451adb22a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a.part --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a.part --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG nova.virt.images [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9 was qcow2, converting to raw {{(pid=71711) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a.part /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a.converted {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:40 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Successfully created port: 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a.part /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a.converted" returned: 0 in 0.296s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a.converted --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "cef3c22c9889719523c9c6bb8c95560451adb22a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.077s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a --force-share --output=json" returned: 0 in 0.157s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "cef3c22c9889719523c9c6bb8c95560451adb22a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "cef3c22c9889719523c9c6bb8c95560451adb22a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Successfully updated port: 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquired lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a --force-share --output=json" returned: 0 in 0.152s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-changed-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Refreshing instance network info cache due to event network-changed-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] Acquiring lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a,backing_fmt=raw /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a,backing_fmt=raw /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk 1073741824" returned: 0 in 0.063s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "cef3c22c9889719523c9c6bb8c95560451adb22a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a --force-share --output=json" returned: 0 in 0.160s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Cannot resize image /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG nova.objects.instance [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'migration_context' on Instance uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Ensure instance console log exists: /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updating instance_info_cache with network_info: [{"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Releasing lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Instance network_info: |[{"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] Acquired lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.network.neutron [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Refreshing network info cache for port 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Start _get_guest_xml network_info=[{"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:47:37Z,direct_url=<?>,disk_format='qcow2',id=bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9,min_disk=0,min_ram=0,name='tempest-scenario-img--582365497',owner='d1aacffb9fbd4398b98db1f1945138dc',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:47:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:47:42 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:47:42 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:47:37Z,direct_url=<?>,disk_format='qcow2',id=bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9,min_disk=0,min_ram=0,name='tempest-scenario-img--582365497',owner='d1aacffb9fbd4398b98db1f1945138dc',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:47:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1404205967',display_name='tempest-TestMinimumBasicScenario-server-1404205967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1404205967',id=39,image_ref='bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYd1vxt6IOrCuDq8XQobzqeuQGl6sxwoZi2oqGAmYsaM1r02sLjpGCkffLXipByEs9yCp4tNOTiJcnVwggG5nCwVGjhlV6IvXoxSNHVUegrF0R0F2o1Aem8cawIyFgPFQ==',key_name='tempest-TestMinimumBasicScenario-1175210425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1aacffb9fbd4398b98db1f1945138dc',ramdisk_id='',reservation_id='r-n0fts2f6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1474504992',owner_user_name='tempest-TestMinimumBasicScenario-1474504992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:47:40Z,user_data=None,user_id='2a188723ace3460792ed32d13bfe0d93',uuid=1d45a146-795c-455e-be0f-93227183720a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converting VIF {"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:47:42 user nova-compute[71711]:   <uuid>1d45a146-795c-455e-be0f-93227183720a</uuid>
Apr 12 06:47:42 user nova-compute[71711]:   <name>instance-00000027</name>
Apr 12 06:47:42 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:47:42 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:47:42 user nova-compute[71711]:   <metadata>
Apr 12 06:47:42 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:47:42 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:47:42 user nova-compute[71711]:       <nova:name>tempest-TestMinimumBasicScenario-server-1404205967</nova:name>
Apr 12 06:47:42 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:47:42</nova:creationTime>
Apr 12 06:47:42 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:47:42 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:47:42 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:47:42 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:47:42 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:47:42 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:47:42 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:47:42 user nova-compute[71711]:       <nova:owner>
Apr 12 06:47:42 user nova-compute[71711]:         <nova:user uuid="2a188723ace3460792ed32d13bfe0d93">tempest-TestMinimumBasicScenario-1474504992-project-member</nova:user>
Apr 12 06:47:42 user nova-compute[71711]:         <nova:project uuid="d1aacffb9fbd4398b98db1f1945138dc">tempest-TestMinimumBasicScenario-1474504992</nova:project>
Apr 12 06:47:42 user nova-compute[71711]:       </nova:owner>
Apr 12 06:47:42 user nova-compute[71711]:       <nova:root type="image" uuid="bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9"/>
Apr 12 06:47:42 user nova-compute[71711]:       <nova:ports>
Apr 12 06:47:42 user nova-compute[71711]:         <nova:port uuid="37cc833c-e20d-4d31-9ecf-389dc5e2f2d6">
Apr 12 06:47:42 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 06:47:42 user nova-compute[71711]:         </nova:port>
Apr 12 06:47:42 user nova-compute[71711]:       </nova:ports>
Apr 12 06:47:42 user nova-compute[71711]:     </nova:instance>
Apr 12 06:47:42 user nova-compute[71711]:   </metadata>
Apr 12 06:47:42 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:47:42 user nova-compute[71711]:     <system>
Apr 12 06:47:42 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:47:42 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:47:42 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:47:42 user nova-compute[71711]:       <entry name="serial">1d45a146-795c-455e-be0f-93227183720a</entry>
Apr 12 06:47:42 user nova-compute[71711]:       <entry name="uuid">1d45a146-795c-455e-be0f-93227183720a</entry>
Apr 12 06:47:42 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:47:42 user nova-compute[71711]:     </system>
Apr 12 06:47:42 user nova-compute[71711]:   </sysinfo>
Apr 12 06:47:42 user nova-compute[71711]:   <os>
Apr 12 06:47:42 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:47:42 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:47:42 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:47:42 user nova-compute[71711]:   </os>
Apr 12 06:47:42 user nova-compute[71711]:   <features>
Apr 12 06:47:42 user nova-compute[71711]:     <acpi/>
Apr 12 06:47:42 user nova-compute[71711]:     <apic/>
Apr 12 06:47:42 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:47:42 user nova-compute[71711]:   </features>
Apr 12 06:47:42 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:47:42 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:47:42 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:47:42 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:47:42 user nova-compute[71711]:   </clock>
Apr 12 06:47:42 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:47:42 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:47:42 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:47:42 user nova-compute[71711]:   </cpu>
Apr 12 06:47:42 user nova-compute[71711]:   <devices>
Apr 12 06:47:42 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:47:42 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:47:42 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk"/>
Apr 12 06:47:42 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:47:42 user nova-compute[71711]:     </disk>
Apr 12 06:47:42 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:47:42 user nova-compute[71711]:       <mac address="fa:16:3e:b4:ca:39"/>
Apr 12 06:47:42 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:47:42 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:47:42 user nova-compute[71711]:       <target dev="tap37cc833c-e2"/>
Apr 12 06:47:42 user nova-compute[71711]:     </interface>
Apr 12 06:47:42 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:47:42 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/console.log" append="off"/>
Apr 12 06:47:42 user nova-compute[71711]:     </serial>
Apr 12 06:47:42 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:47:42 user nova-compute[71711]:     <video>
Apr 12 06:47:42 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:47:42 user nova-compute[71711]:     </video>
Apr 12 06:47:42 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:47:42 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:47:42 user nova-compute[71711]:     </rng>
Apr 12 06:47:42 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:47:42 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:47:42 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:47:42 user nova-compute[71711]:     </memballoon>
Apr 12 06:47:42 user nova-compute[71711]:   </devices>
Apr 12 06:47:42 user nova-compute[71711]: </domain>
Apr 12 06:47:42 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1404205967',display_name='tempest-TestMinimumBasicScenario-server-1404205967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1404205967',id=39,image_ref='bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYd1vxt6IOrCuDq8XQobzqeuQGl6sxwoZi2oqGAmYsaM1r02sLjpGCkffLXipByEs9yCp4tNOTiJcnVwggG5nCwVGjhlV6IvXoxSNHVUegrF0R0F2o1Aem8cawIyFgPFQ==',key_name='tempest-TestMinimumBasicScenario-1175210425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1aacffb9fbd4398b98db1f1945138dc',ramdisk_id='',reservation_id='r-n0fts2f6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1474504992',owner_user_name='tempest-TestMinimumBasicScenario-1474504992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:47:40Z,user_data=None,user_id='2a188723ace3460792ed32d13bfe0d93',uuid=1d45a146-795c-455e-be0f-93227183720a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converting VIF {"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG os_vif [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37cc833c-e2, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37cc833c-e2, col_values=(('external_ids', {'iface-id': '37cc833c-e20d-4d31-9ecf-389dc5e2f2d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:ca:39', 'vm-uuid': '1d45a146-795c-455e-be0f-93227183720a'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:42 user nova-compute[71711]: INFO os_vif [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2')
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] No VIF found with MAC fa:16:3e:b4:ca:39, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.network.neutron [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updated VIF entry in instance network info cache for port 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG nova.network.neutron [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updating instance_info_cache with network_info: [{"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:47:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1b3bffd8-465d-47a6-9b9b-9fcb26e036ee req-f2144e45-3bd2-4587-8948-ae2bdf37bcf1 service nova] Releasing lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:47:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-ff7508fd-970e-4a50-a66c-1bcd8f4fff58 req-c7a0b417-a71b-4f68-a2e7-51662aebdc7d service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:47:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ff7508fd-970e-4a50-a66c-1bcd8f4fff58 req-c7a0b417-a71b-4f68-a2e7-51662aebdc7d service nova] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ff7508fd-970e-4a50-a66c-1bcd8f4fff58 req-c7a0b417-a71b-4f68-a2e7-51662aebdc7d service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ff7508fd-970e-4a50-a66c-1bcd8f4fff58 req-c7a0b417-a71b-4f68-a2e7-51662aebdc7d service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-ff7508fd-970e-4a50-a66c-1bcd8f4fff58 req-c7a0b417-a71b-4f68-a2e7-51662aebdc7d service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] No waiting events found dispatching network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:47:43 user nova-compute[71711]: WARNING nova.compute.manager [req-ff7508fd-970e-4a50-a66c-1bcd8f4fff58 req-c7a0b417-a71b-4f68-a2e7-51662aebdc7d service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received unexpected event network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance with vm_state building and task_state spawning.
Apr 12 06:47:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282065.6906734, 1d45a146-795c-455e-be0f-93227183720a => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:47:45 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] VM Resumed (Lifecycle Event)
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:47:45 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 1d45a146-795c-455e-be0f-93227183720a] Instance spawned successfully.
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:47:45 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282065.6940322, 1d45a146-795c-455e-be0f-93227183720a => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:47:45 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] VM Started (Lifecycle Event)
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:47:45 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:47:45 user nova-compute[71711]: INFO nova.compute.manager [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Took 5.62 seconds to spawn the instance on the hypervisor.
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.compute.manager [req-960c486b-9a27-4dda-899c-beadc526e25d req-c7b4b456-c57f-4078-9d40-e17e808ce4b1 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-960c486b-9a27-4dda-899c-beadc526e25d req-c7b4b456-c57f-4078-9d40-e17e808ce4b1 service nova] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-960c486b-9a27-4dda-899c-beadc526e25d req-c7b4b456-c57f-4078-9d40-e17e808ce4b1 service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-960c486b-9a27-4dda-899c-beadc526e25d req-c7b4b456-c57f-4078-9d40-e17e808ce4b1 service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:45 user nova-compute[71711]: DEBUG nova.compute.manager [req-960c486b-9a27-4dda-899c-beadc526e25d req-c7b4b456-c57f-4078-9d40-e17e808ce4b1 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] No waiting events found dispatching network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:47:45 user nova-compute[71711]: WARNING nova.compute.manager [req-960c486b-9a27-4dda-899c-beadc526e25d req-c7b4b456-c57f-4078-9d40-e17e808ce4b1 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received unexpected event network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance with vm_state building and task_state spawning.
Apr 12 06:47:45 user nova-compute[71711]: INFO nova.compute.manager [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Took 6.13 seconds to build instance.
Apr 12 06:47:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5987a0e-af64-48dd-97cc-650433407a6e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.229s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:47:46 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681282051.5658288, 20f055ae-909d-4fda-a2d5-0f4aef77928e => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:47:46 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] VM Stopped (Lifecycle Event)
Apr 12 06:47:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1885ca74-c36b-4722-8816-fffe878893d3 None None] [instance: 20f055ae-909d-4fda-a2d5-0f4aef77928e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:47:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:53 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:47:55 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:47:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:47:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:47:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:47:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:47:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:47:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:47:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:01 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:02 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:03 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:03 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:03 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:48:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-9b4783e1-34e3-425c-87c3-ee8bda2c6853" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-9b4783e1-34e3-425c-87c3-ee8bda2c6853" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Updating instance_info_cache with network_info: [{"id": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "address": "fa:16:3e:47:da:87", "network": {"id": "1006f4e0-e12c-47c3-8455-c2f9778b12a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d17c81157dc240a396f20e397d55ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8cf137-97", "ovs_interfaceid": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-9b4783e1-34e3-425c-87c3-ee8bda2c6853" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:48:06 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:48:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:48:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:48:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:48:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:48:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:48:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:48:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:48:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:48:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:48:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:48:07 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:48:08 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:48:08 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8494MB free_disk=26.159568786621094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 02209375-f25a-4d51-9828-3422144c2ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 1d45a146-795c-455e-be0f-93227183720a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing inventories for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating ProviderTree inventory for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating inventory in ProviderTree for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing aggregate associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, aggregates: None {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing trait associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, traits: HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:48:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:48:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:48:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:48:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:48:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:48:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:48:10 user nova-compute[71711]: INFO nova.compute.manager [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Terminating instance
Apr 12 06:48:10 user nova-compute[71711]: DEBUG nova.compute.manager [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] There are 0 instances to clean {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-1aa500d8-e7d3-44cf-8040-83a95d441142 req-9f67978c-bda5-4b31-bd7e-76d6621664c7 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Received event network-vif-unplugged-ad8cf137-9750-4de8-8c9e-1fca491a3348 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1aa500d8-e7d3-44cf-8040-83a95d441142 req-9f67978c-bda5-4b31-bd7e-76d6621664c7 service nova] Acquiring lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1aa500d8-e7d3-44cf-8040-83a95d441142 req-9f67978c-bda5-4b31-bd7e-76d6621664c7 service nova] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1aa500d8-e7d3-44cf-8040-83a95d441142 req-9f67978c-bda5-4b31-bd7e-76d6621664c7 service nova] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-1aa500d8-e7d3-44cf-8040-83a95d441142 req-9f67978c-bda5-4b31-bd7e-76d6621664c7 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] No waiting events found dispatching network-vif-unplugged-ad8cf137-9750-4de8-8c9e-1fca491a3348 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG nova.compute.manager [req-1aa500d8-e7d3-44cf-8040-83a95d441142 req-9f67978c-bda5-4b31-bd7e-76d6621664c7 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Received event network-vif-unplugged-ad8cf137-9750-4de8-8c9e-1fca491a3348 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:48:10 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Instance destroyed successfully.
Apr 12 06:48:10 user nova-compute[71711]: DEBUG nova.objects.instance [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lazy-loading 'resources' on Instance uuid 9b4783e1-34e3-425c-87c3-ee8bda2c6853 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:46:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1603035936',display_name='tempest-VolumesNegativeTest-instance-1603035936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1603035936',id=37,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5098984b6bda4c2d9a71023292e7815c',ramdisk_id='',reservation_id='r-ky8swxpt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-289347363',owner_user_name='tempest-VolumesNegativeTest-289347363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:46:26Z,user_data=None,user_id='c93cca7970df482f8c3a00f15ef12fde',uuid=9b4783e1-34e3-425c-87c3-ee8bda2c6853,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "address": "fa:16:3e:47:da:87", "network": {"id": "1006f4e0-e12c-47c3-8455-c2f9778b12a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d17c81157dc240a396f20e397d55ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8cf137-97", "ovs_interfaceid": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Converting VIF {"id": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "address": "fa:16:3e:47:da:87", "network": {"id": "1006f4e0-e12c-47c3-8455-c2f9778b12a2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d17c81157dc240a396f20e397d55ef65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8cf137-97", "ovs_interfaceid": "ad8cf137-9750-4de8-8c9e-1fca491a3348", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:da:87,bridge_name='br-int',has_traffic_filtering=True,id=ad8cf137-9750-4de8-8c9e-1fca491a3348,network=Network(1006f4e0-e12c-47c3-8455-c2f9778b12a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8cf137-97') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG os_vif [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:da:87,bridge_name='br-int',has_traffic_filtering=True,id=ad8cf137-9750-4de8-8c9e-1fca491a3348,network=Network(1006f4e0-e12c-47c3-8455-c2f9778b12a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8cf137-97') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad8cf137-97, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:48:10 user nova-compute[71711]: INFO os_vif [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:da:87,bridge_name='br-int',has_traffic_filtering=True,id=ad8cf137-9750-4de8-8c9e-1fca491a3348,network=Network(1006f4e0-e12c-47c3-8455-c2f9778b12a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8cf137-97')
Apr 12 06:48:10 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Deleting instance files /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853_del
Apr 12 06:48:10 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Deletion of /opt/stack/data/nova/instances/9b4783e1-34e3-425c-87c3-ee8bda2c6853_del complete
Apr 12 06:48:10 user nova-compute[71711]: INFO nova.compute.manager [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 06:48:10 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:48:10 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:48:11 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:48:11 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Took 0.45 seconds to deallocate network for instance.
Apr 12 06:48:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-b8736e6d-8a51-457c-8893-f45140f653d4 req-6c710e74-1f86-42d4-978c-0c275dd84cd8 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Received event network-vif-deleted-ad8cf137-9750-4de8-8c9e-1fca491a3348 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:48:11 user nova-compute[71711]: INFO nova.compute.manager [req-b8736e6d-8a51-457c-8893-f45140f653d4 req-6c710e74-1f86-42d4-978c-0c275dd84cd8 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Neutron deleted interface ad8cf137-9750-4de8-8c9e-1fca491a3348; detaching it from the instance and deleting it from the info cache
Apr 12 06:48:11 user nova-compute[71711]: DEBUG nova.network.neutron [req-b8736e6d-8a51-457c-8893-f45140f653d4 req-6c710e74-1f86-42d4-978c-0c275dd84cd8 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:48:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-b8736e6d-8a51-457c-8893-f45140f653d4 req-6c710e74-1f86-42d4-978c-0c275dd84cd8 service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Detach interface failed, port_id=ad8cf137-9750-4de8-8c9e-1fca491a3348, reason: Instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853 could not be found. {{(pid=71711) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 06:48:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:48:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:48:11 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:48:11 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:48:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:48:11 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Deleted allocations for instance 9b4783e1-34e3-425c-87c3-ee8bda2c6853
Apr 12 06:48:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-1edd26f5-f090-4a61-80f6-e77c2dd16b95 tempest-VolumesNegativeTest-289347363 tempest-VolumesNegativeTest-289347363-project-member] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.751s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:48:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-78c7d7a1-b1a6-4695-9927-fef5b0a78378 req-5cd66722-a4d1-4fe4-b7c3-88d7494cf1ef service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Received event network-vif-plugged-ad8cf137-9750-4de8-8c9e-1fca491a3348 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:48:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-78c7d7a1-b1a6-4695-9927-fef5b0a78378 req-5cd66722-a4d1-4fe4-b7c3-88d7494cf1ef service nova] Acquiring lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:48:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-78c7d7a1-b1a6-4695-9927-fef5b0a78378 req-5cd66722-a4d1-4fe4-b7c3-88d7494cf1ef service nova] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:48:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-78c7d7a1-b1a6-4695-9927-fef5b0a78378 req-5cd66722-a4d1-4fe4-b7c3-88d7494cf1ef service nova] Lock "9b4783e1-34e3-425c-87c3-ee8bda2c6853-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:48:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-78c7d7a1-b1a6-4695-9927-fef5b0a78378 req-5cd66722-a4d1-4fe4-b7c3-88d7494cf1ef service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] No waiting events found dispatching network-vif-plugged-ad8cf137-9750-4de8-8c9e-1fca491a3348 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:48:12 user nova-compute[71711]: WARNING nova.compute.manager [req-78c7d7a1-b1a6-4695-9927-fef5b0a78378 req-5cd66722-a4d1-4fe4-b7c3-88d7494cf1ef service nova] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Received unexpected event network-vif-plugged-ad8cf137-9750-4de8-8c9e-1fca491a3348 for instance with vm_state deleted and task_state None.
Apr 12 06:48:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71711) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 06:48:18 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:25 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681282090.7618957, 9b4783e1-34e3-425c-87c3-ee8bda2c6853 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:48:25 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] VM Stopped (Lifecycle Event)
Apr 12 06:48:25 user nova-compute[71711]: DEBUG nova.compute.manager [None req-fb3a3c74-dd30-435e-82d1-b1920cbcc3f4 None None] [instance: 9b4783e1-34e3-425c-87c3-ee8bda2c6853] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:48:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:48:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-changed-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:48:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Refreshing instance network info cache due to event network-changed-e6c75186-26c0-414f-9dfe-13cb03283057. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:48:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] Acquiring lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:48:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] Acquired lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:48:34 user nova-compute[71711]: DEBUG nova.network.neutron [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Refreshing network info cache for port e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:48:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:34 user nova-compute[71711]: DEBUG nova.network.neutron [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updated VIF entry in instance network info cache for port e6c75186-26c0-414f-9dfe-13cb03283057. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:48:34 user nova-compute[71711]: DEBUG nova.network.neutron [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updating instance_info_cache with network_info: [{"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:48:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f5556b73-7c5c-4f7b-ba52-06bd5ee698b0 req-d72f7709-fa3b-4fa1-bcd4-e5c888144dba service nova] Releasing lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:48:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:48:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "02209375-f25a-4d51-9828-3422144c2ed8" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:48:36 user nova-compute[71711]: INFO nova.compute.manager [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Shelving
Apr 12 06:48:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-9e3f5ec3-8633-4a57-ae12-45cb91f78d46 req-8f03559a-e21a-401f-8bca-3e6fe1e83041 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-unplugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:48:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9e3f5ec3-8633-4a57-ae12-45cb91f78d46 req-8f03559a-e21a-401f-8bca-3e6fe1e83041 service nova] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:48:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9e3f5ec3-8633-4a57-ae12-45cb91f78d46 req-8f03559a-e21a-401f-8bca-3e6fe1e83041 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:48:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9e3f5ec3-8633-4a57-ae12-45cb91f78d46 req-8f03559a-e21a-401f-8bca-3e6fe1e83041 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:48:37 user nova-compute[71711]: DEBUG nova.compute.manager [req-9e3f5ec3-8633-4a57-ae12-45cb91f78d46 req-8f03559a-e21a-401f-8bca-3e6fe1e83041 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] No waiting events found dispatching network-vif-unplugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:48:37 user nova-compute[71711]: WARNING nova.compute.manager [req-9e3f5ec3-8633-4a57-ae12-45cb91f78d46 req-8f03559a-e21a-401f-8bca-3e6fe1e83041 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received unexpected event network-vif-unplugged-e6c75186-26c0-414f-9dfe-13cb03283057 for instance with vm_state active and task_state shelving.
Apr 12 06:48:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:37 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Instance destroyed successfully.
Apr 12 06:48:37 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Beginning cold snapshot process
Apr 12 06:48:37 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:48:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk /opt/stack/data/nova/instances/snapshots/tmp6j6zarzo/54070adbaf6b47369abd98850561e488 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:48:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk /opt/stack/data/nova/instances/snapshots/tmp6j6zarzo/54070adbaf6b47369abd98850561e488" returned: 0 in 0.565s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:48:38 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Snapshot extracted, beginning image upload
Apr 12 06:48:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-98e884d4-a642-4422-a5b6-65cf02be1944 req-93f645ca-1bb5-492e-8890-3b3a2aee8294 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:48:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-98e884d4-a642-4422-a5b6-65cf02be1944 req-93f645ca-1bb5-492e-8890-3b3a2aee8294 service nova] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:48:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-98e884d4-a642-4422-a5b6-65cf02be1944 req-93f645ca-1bb5-492e-8890-3b3a2aee8294 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:48:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-98e884d4-a642-4422-a5b6-65cf02be1944 req-93f645ca-1bb5-492e-8890-3b3a2aee8294 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:48:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-98e884d4-a642-4422-a5b6-65cf02be1944 req-93f645ca-1bb5-492e-8890-3b3a2aee8294 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] No waiting events found dispatching network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:48:39 user nova-compute[71711]: WARNING nova.compute.manager [req-98e884d4-a642-4422-a5b6-65cf02be1944 req-93f645ca-1bb5-492e-8890-3b3a2aee8294 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received unexpected event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 06:48:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:40 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Snapshot image upload complete
Apr 12 06:48:40 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:48:40 user nova-compute[71711]: INFO nova.compute.manager [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Shelve offloading
Apr 12 06:48:40 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Instance destroyed successfully.
Apr 12 06:48:40 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:48:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:48:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquired lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:48:40 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:48:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updating instance_info_cache with network_info: [{"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Releasing lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:48:41 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Instance destroyed successfully.
Apr 12 06:48:41 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'resources' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2020171009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2020171009',id=38,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZegZIYK1I87WzI/GopP0gFDiVIk2m3tD+Xr8CMKYFLScduowkDoSCdMQjYZBkxgp/FVmCcjJUpm9/3fq/7gj6jh4/k43FpV6VBh16G/3bTDxKZLcvBw9dpNKFRqAyABQ==',key_name='tempest-keypair-914952928',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:46:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='76a8460ce5c24d1db20e80a1659133f7',ramdisk_id='',reservation_id='r-5iy62es8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1986658224',owner_user_name='tempest-AttachVolumeShelveTestJSON-1986658224-project-member',shelved_at='2023-04-12T06:48:40.563413',shelved_host='user',shelved_image_id='3230c0bb-d5de-4913-80ad-dbfd5fcd5478'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:48:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fbb8c37e5a74a0b83011c2a21033204',uuid=02209375-f25a-4d51-9828-3422144c2ed8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converting VIF {"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG os_vif [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6c75186-26, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:48:41 user nova-compute[71711]: INFO os_vif [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26')
Apr 12 06:48:41 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Deleting instance files /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8_del
Apr 12 06:48:41 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Deletion of /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8_del complete
Apr 12 06:48:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-changed-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Refreshing instance network info cache due to event network-changed-e6c75186-26c0-414f-9dfe-13cb03283057. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] Acquiring lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] Acquired lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG nova.network.neutron [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Refreshing network info cache for port e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:48:41 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Deleted allocations for instance 02209375-f25a-4d51-9828-3422144c2ed8
Apr 12 06:48:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'numa_topology' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:48:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:48:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a9adabf7-3eb8-452c-a44f-5f0a172a26de tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "02209375-f25a-4d51-9828-3422144c2ed8" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.220s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:48:42 user nova-compute[71711]: DEBUG nova.network.neutron [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updated VIF entry in instance network info cache for port e6c75186-26c0-414f-9dfe-13cb03283057. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:48:42 user nova-compute[71711]: DEBUG nova.network.neutron [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updating instance_info_cache with network_info: [{"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape6c75186-26", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:48:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5f754c9f-b655-47c9-be44-84468e2795d2 req-199443dd-9138-4f36-bcee-a005aa79f9db service nova] Releasing lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:48:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:45 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:46 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:48:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:48:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "1d45a146-795c-455e-be0f-93227183720a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:48:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "1d45a146-795c-455e-be0f-93227183720a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:48:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:48:52 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681282117.419143, 02209375-f25a-4d51-9828-3422144c2ed8 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:48:52 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] VM Stopped (Lifecycle Event)
Apr 12 06:48:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-765d2d43-7151-4efe-a860-0f7555494df5 None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:48:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:48:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:02 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:49:02 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:49:03 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:49:04 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:49:04 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:49:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:49:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:07 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:08 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:49:08 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:49:08 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8713MB free_disk=26.16008758544922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 1d45a146-795c-455e-be0f-93227183720a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:49:08 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:49:09 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:49:09 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:49:09 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:49:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "755c4de9-18c0-457d-b834-d21aab2141a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "755c4de9-18c0-457d-b834-d21aab2141a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:49:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:27 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:49:27 user nova-compute[71711]: INFO nova.compute.claims [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Claim successful on node user
Apr 12 06:49:27 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:49:27 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:49:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:49:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:49:27 user nova-compute[71711]: DEBUG nova.network.neutron [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:49:27 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:49:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:49:27 user nova-compute[71711]: INFO nova.virt.block_device [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Booting with volume snapshot 90fb009e-81f5-45c6-bbfe-8330a5ff1ac3 at /dev/vda
Apr 12 06:49:27 user nova-compute[71711]: DEBUG nova.policy [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:49:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Successfully created port: 81437106-cc33-4c4b-ac7f-98d2393c84dc {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:49:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Successfully updated port: 81437106-cc33-4c4b-ac7f-98d2393c84dc {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:49:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "refresh_cache-755c4de9-18c0-457d-b834-d21aab2141a8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:49:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquired lock "refresh_cache-755c4de9-18c0-457d-b834-d21aab2141a8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:49:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:49:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Received event network-changed-81437106-cc33-4c4b-ac7f-98d2393c84dc {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:49:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Refreshing instance network info cache due to event network-changed-81437106-cc33-4c4b-ac7f-98d2393c84dc. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:49:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] Acquiring lock "refresh_cache-755c4de9-18c0-457d-b834-d21aab2141a8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:49:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:49:29 user nova-compute[71711]: DEBUG nova.network.neutron [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Updating instance_info_cache with network_info: [{"id": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "address": "fa:16:3e:05:33:33", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81437106-cc", "ovs_interfaceid": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:49:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Releasing lock "refresh_cache-755c4de9-18c0-457d-b834-d21aab2141a8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:49:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Instance network_info: |[{"id": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "address": "fa:16:3e:05:33:33", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81437106-cc", "ovs_interfaceid": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:49:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] Acquired lock "refresh_cache-755c4de9-18c0-457d-b834-d21aab2141a8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:49:29 user nova-compute[71711]: DEBUG nova.network.neutron [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Refreshing network info cache for port 81437106-cc33-4c4b-ac7f-98d2393c84dc {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:49:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:29 user nova-compute[71711]: DEBUG nova.network.neutron [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Updated VIF entry in instance network info cache for port 81437106-cc33-4c4b-ac7f-98d2393c84dc. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:49:29 user nova-compute[71711]: DEBUG nova.network.neutron [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Updating instance_info_cache with network_info: [{"id": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "address": "fa:16:3e:05:33:33", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81437106-cc", "ovs_interfaceid": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:49:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f4656ae0-8e57-4d80-ac8a-b45653cd823c req-1403b766-6603-46e9-8df6-d825f35194b8 service nova] Releasing lock "refresh_cache-755c4de9-18c0-457d-b834-d21aab2141a8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:49:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:31 user nova-compute[71711]: DEBUG nova.objects.instance [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'flavor' on Instance uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:49:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:31 user nova-compute[71711]: INFO nova.compute.manager [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Attaching volume e07c955b-abdd-446f-9137-d12aef35b2c5 to /dev/vdb
Apr 12 06:49:32 user nova-compute[71711]: DEBUG os_brick.utils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4afa97-b211-492d-b772-33c9cf2c7f23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e4d12e-2326-48f9-8bec-d24ad1309b7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2675c08f-13e0-45ec-8921-530efa4d5acb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e5c4be-3f0f-457b-b6cf-60b742bcac7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:49:32 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:49:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb03fb13-f2bc-4515-8db0-2d46ea82d075]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG os_brick.utils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:49:32 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updating existing volume attachment record: 8be0b98d-dfeb-4bd5-94bb-8864d4c51c4f {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG os_brick.utils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[57278177-415d-4b31-a301-c686b893d1ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4832363b-f468-450a-9f8b-8a32059d6000]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[594af399-ac26-49c6-922f-f42a70d2313e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ed75e4-c75c-4c05-a532-93df957f3c21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:49:33 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:49:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bb14c7-03e4-49c8-bffb-1fc166c78f62]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG os_brick.utils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:49:33 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Updating existing volume attachment record: 9093a1bd-7453-4277-81b8-fb4e0af41d73 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:49:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtjuFhmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:49:36 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:49:36 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:49:36 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[899f23d8-fe04-47b0-90f5-b6922ece3bcd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:49:36 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[56da6770-7718-49ab-a254-7ef422113d73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5] added
Apr 12 06:49:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee4f92e-d7f8-4166-98df-8a12c7e83d62]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f710f0-a9c7-43dc-8cd0-4703881d3f36]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtjuFhmD {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtjuFhmD" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[966b7016-0763-4e88-9d1c-6a0bd41a76b6]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UtjuFhmD'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3a7d2a-d0bf-4c42-9117-088073d25210]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f081ca4e-9600-401f-bd8a-3186cee22f9d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:49:36 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:49:36 user nova-compute[71711]:  {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:49:36 user nova-compute[71711]: WARNING os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 06:49:36 user nova-compute[71711]: 
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc12a8e-0811-47c4-bffc-415f9981441e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260]
Apr 12 06:49:36 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260] successful.
Apr 12 06:49:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b300b103-65f2-449b-846d-2e8250ed35b8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4715a0-d125-4bc6-89c0-dc8f599dfb5e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:49:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:49:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace77fd8-3832-43cf-8fb4-9d55db18f68f]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtjuFhmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:49:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26163646133646236', 'path': '/dev/sdb'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163646133646236', 'path': '/dev/sdb'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.objects.instance [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'flavor' on Instance uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:49:37 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:49:37 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:49:37 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:49:37 user nova-compute[71711]:   <serial>e07c955b-abdd-446f-9137-d12aef35b2c5</serial>
Apr 12 06:49:37 user nova-compute[71711]: </disk>
Apr 12 06:49:37 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.compute.manager [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:49:37 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Creating image(s)
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Ensure instance console log exists: /opt/stack/data/nova/instances/755c4de9-18c0-457d-b834-d21aab2141a8/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Start _get_guest_xml network_info=[{"id": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "address": "fa:16:3e:05:33:33", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81437106-cc", "ovs_interfaceid": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgDfYWth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '755c4de9-18c0-457d-b834-d21aab2141a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'serial': 'a5b554b9-110c-4f1f-9fe6-a30e2120f7af'}, 'attachment_id': '9093a1bd-7453-4277-81b8-fb4e0af41d73', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:49:37 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:49:37 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgDfYWth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:49:37 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:49:37 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:49:37 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0d9d32-afbc-4d1f-a808-cf823d3426be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:49:37 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cfa6df-da91-4f71-8a49-fb48255699f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af] added
Apr 12 06:49:37 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3c9cc8-b7d1-4de5-800d-bdd92b624f09]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7238c46-5d4b-4df5-a3ed-f5368a8af702]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NgDfYWth {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NgDfYWth" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea6683d-e61f-4b86-90aa-1ad27f57f448]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NgDfYWth'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e494717-9575-45f0-9e36-6249d746d1b1]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4db49be-ef4f-4258-98c7-46d5d903c78b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:49:37 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:49:37 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca0c7ce-2ff8-4278-a912-1c35c5b17108]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af, portal: 172.16.0.220,3260]
Apr 12 06:49:37 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af, portal: 172.16.0.220,3260] successful.
Apr 12 06:49:37 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[401b90f6-96f8-4cfa-8aee-5d972a68dd53]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cb3e13-c566-4f40-8dc0-7b92f76c05a5]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:49:37 user nova-compute[71711]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:49:37 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:49:37 user nova-compute[71711]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:49:37 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7aea32-1057-48eb-b1d5-f099ae9e1315]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:49:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgDfYWth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:49:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:49:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:49:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] No VIF found with MAC fa:16:3e:b4:ca:39, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:49:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4ca3a70b-fdd0-46e9-b7de-c46e01834cc3 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.199s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:49:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23031363230303032', 'path': '/dev/sdc'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:49:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031363230303032', 'path': '/dev/sdc'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-86781039',display_name='tempest-TestVolumeBootPattern-server-86781039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-86781039',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-44aavoj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:49:28Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=755c4de9-18c0-457d-b834-d21aab2141a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "address": "fa:16:3e:05:33:33", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81437106-cc", "ovs_interfaceid": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "address": "fa:16:3e:05:33:33", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81437106-cc", "ovs_interfaceid": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:33:33,bridge_name='br-int',has_traffic_filtering=True,id=81437106-cc33-4c4b-ac7f-98d2393c84dc,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81437106-cc') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG nova.objects.instance [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lazy-loading 'pci_devices' on Instance uuid 755c4de9-18c0-457d-b834-d21aab2141a8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:49:39 user nova-compute[71711]:   <uuid>755c4de9-18c0-457d-b834-d21aab2141a8</uuid>
Apr 12 06:49:39 user nova-compute[71711]:   <name>instance-00000028</name>
Apr 12 06:49:39 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:49:39 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:49:39 user nova-compute[71711]:   <metadata>
Apr 12 06:49:39 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:49:39 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:49:39 user nova-compute[71711]:       <nova:name>tempest-TestVolumeBootPattern-server-86781039</nova:name>
Apr 12 06:49:39 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:49:37</nova:creationTime>
Apr 12 06:49:39 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:49:39 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:49:39 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:49:39 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:49:39 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:49:39 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:49:39 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:49:39 user nova-compute[71711]:       <nova:owner>
Apr 12 06:49:39 user nova-compute[71711]:         <nova:user uuid="1fec39f776464d339142eeed1ba95a6d">tempest-TestVolumeBootPattern-294210775-project-member</nova:user>
Apr 12 06:49:39 user nova-compute[71711]:         <nova:project uuid="13d1513e8b784c758412ddfc2692bb22">tempest-TestVolumeBootPattern-294210775</nova:project>
Apr 12 06:49:39 user nova-compute[71711]:       </nova:owner>
Apr 12 06:49:39 user nova-compute[71711]:       <nova:ports>
Apr 12 06:49:39 user nova-compute[71711]:         <nova:port uuid="81437106-cc33-4c4b-ac7f-98d2393c84dc">
Apr 12 06:49:39 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 06:49:39 user nova-compute[71711]:         </nova:port>
Apr 12 06:49:39 user nova-compute[71711]:       </nova:ports>
Apr 12 06:49:39 user nova-compute[71711]:     </nova:instance>
Apr 12 06:49:39 user nova-compute[71711]:   </metadata>
Apr 12 06:49:39 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:49:39 user nova-compute[71711]:     <system>
Apr 12 06:49:39 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:49:39 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:49:39 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:49:39 user nova-compute[71711]:       <entry name="serial">755c4de9-18c0-457d-b834-d21aab2141a8</entry>
Apr 12 06:49:39 user nova-compute[71711]:       <entry name="uuid">755c4de9-18c0-457d-b834-d21aab2141a8</entry>
Apr 12 06:49:39 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:49:39 user nova-compute[71711]:     </system>
Apr 12 06:49:39 user nova-compute[71711]:   </sysinfo>
Apr 12 06:49:39 user nova-compute[71711]:   <os>
Apr 12 06:49:39 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:49:39 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:49:39 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:49:39 user nova-compute[71711]:   </os>
Apr 12 06:49:39 user nova-compute[71711]:   <features>
Apr 12 06:49:39 user nova-compute[71711]:     <acpi/>
Apr 12 06:49:39 user nova-compute[71711]:     <apic/>
Apr 12 06:49:39 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:49:39 user nova-compute[71711]:   </features>
Apr 12 06:49:39 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:49:39 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:49:39 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:49:39 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:49:39 user nova-compute[71711]:   </clock>
Apr 12 06:49:39 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:49:39 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:49:39 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:49:39 user nova-compute[71711]:   </cpu>
Apr 12 06:49:39 user nova-compute[71711]:   <devices>
Apr 12 06:49:39 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:49:39 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:49:39 user nova-compute[71711]:       <source dev="/dev/sdc"/>
Apr 12 06:49:39 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:49:39 user nova-compute[71711]:       <serial>a5b554b9-110c-4f1f-9fe6-a30e2120f7af</serial>
Apr 12 06:49:39 user nova-compute[71711]:     </disk>
Apr 12 06:49:39 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:49:39 user nova-compute[71711]:       <mac address="fa:16:3e:05:33:33"/>
Apr 12 06:49:39 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:49:39 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:49:39 user nova-compute[71711]:       <target dev="tap81437106-cc"/>
Apr 12 06:49:39 user nova-compute[71711]:     </interface>
Apr 12 06:49:39 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:49:39 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/755c4de9-18c0-457d-b834-d21aab2141a8/console.log" append="off"/>
Apr 12 06:49:39 user nova-compute[71711]:     </serial>
Apr 12 06:49:39 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:49:39 user nova-compute[71711]:     <video>
Apr 12 06:49:39 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:49:39 user nova-compute[71711]:     </video>
Apr 12 06:49:39 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:49:39 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:49:39 user nova-compute[71711]:     </rng>
Apr 12 06:49:39 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:49:39 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:49:39 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:49:39 user nova-compute[71711]:     </memballoon>
Apr 12 06:49:39 user nova-compute[71711]:   </devices>
Apr 12 06:49:39 user nova-compute[71711]: </domain>
Apr 12 06:49:39 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-86781039',display_name='tempest-TestVolumeBootPattern-server-86781039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-86781039',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-44aavoj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:49:28Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=755c4de9-18c0-457d-b834-d21aab2141a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "address": "fa:16:3e:05:33:33", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81437106-cc", "ovs_interfaceid": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "address": "fa:16:3e:05:33:33", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81437106-cc", "ovs_interfaceid": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:33:33,bridge_name='br-int',has_traffic_filtering=True,id=81437106-cc33-4c4b-ac7f-98d2393c84dc,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81437106-cc') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG os_vif [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:33:33,bridge_name='br-int',has_traffic_filtering=True,id=81437106-cc33-4c4b-ac7f-98d2393c84dc,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81437106-cc') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81437106-cc, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81437106-cc, col_values=(('external_ids', {'iface-id': '81437106-cc33-4c4b-ac7f-98d2393c84dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:33:33', 'vm-uuid': '755c4de9-18c0-457d-b834-d21aab2141a8'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:39 user nova-compute[71711]: INFO os_vif [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:33:33,bridge_name='br-int',has_traffic_filtering=True,id=81437106-cc33-4c4b-ac7f-98d2393c84dc,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81437106-cc')
Apr 12 06:49:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:49:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] No VIF found with MAC fa:16:3e:05:33:33, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:49:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-c7cee6f8-30b0-4e4d-a914-ff8f2cc0750f req-b0e83998-5673-4816-9fe2-2286b99f82e1 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Received event network-vif-plugged-81437106-cc33-4c4b-ac7f-98d2393c84dc {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:49:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7cee6f8-30b0-4e4d-a914-ff8f2cc0750f req-b0e83998-5673-4816-9fe2-2286b99f82e1 service nova] Acquiring lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7cee6f8-30b0-4e4d-a914-ff8f2cc0750f req-b0e83998-5673-4816-9fe2-2286b99f82e1 service nova] Lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c7cee6f8-30b0-4e4d-a914-ff8f2cc0750f req-b0e83998-5673-4816-9fe2-2286b99f82e1 service nova] Lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-c7cee6f8-30b0-4e4d-a914-ff8f2cc0750f req-b0e83998-5673-4816-9fe2-2286b99f82e1 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] No waiting events found dispatching network-vif-plugged-81437106-cc33-4c4b-ac7f-98d2393c84dc {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:49:40 user nova-compute[71711]: WARNING nova.compute.manager [req-c7cee6f8-30b0-4e4d-a914-ff8f2cc0750f req-b0e83998-5673-4816-9fe2-2286b99f82e1 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Received unexpected event network-vif-plugged-81437106-cc33-4c4b-ac7f-98d2393c84dc for instance with vm_state building and task_state spawning.
Apr 12 06:49:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-changed-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:49:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Refreshing instance network info cache due to event network-changed-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:49:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] Acquiring lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:49:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] Acquired lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:49:41 user nova-compute[71711]: DEBUG nova.network.neutron [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Refreshing network info cache for port 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.network.neutron [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updated VIF entry in instance network info cache for port 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.network.neutron [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updating instance_info_cache with network_info: [{"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-851897a0-634c-4a4b-90c4-36dfef226c18 req-f3a9d196-e635-4ffc-8b24-ebb1022fa699 service nova] Releasing lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282182.4687324, 755c4de9-18c0-457d-b834-d21aab2141a8 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:49:42 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] VM Resumed (Lifecycle Event)
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.compute.manager [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:49:42 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Instance spawned successfully.
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:49:42 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282182.4705853, 755c4de9-18c0-457d-b834-d21aab2141a8 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:49:42 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] VM Started (Lifecycle Event)
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:49:42 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:49:42 user nova-compute[71711]: INFO nova.compute.manager [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Took 4.96 seconds to spawn the instance on the hypervisor.
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.compute.manager [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-5238e640-35fa-4879-be17-45ee92c35453 req-64cc6709-3143-4ca1-aaeb-365a3cdb1a6e service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Received event network-vif-plugged-81437106-cc33-4c4b-ac7f-98d2393c84dc {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5238e640-35fa-4879-be17-45ee92c35453 req-64cc6709-3143-4ca1-aaeb-365a3cdb1a6e service nova] Acquiring lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5238e640-35fa-4879-be17-45ee92c35453 req-64cc6709-3143-4ca1-aaeb-365a3cdb1a6e service nova] Lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5238e640-35fa-4879-be17-45ee92c35453 req-64cc6709-3143-4ca1-aaeb-365a3cdb1a6e service nova] Lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-5238e640-35fa-4879-be17-45ee92c35453 req-64cc6709-3143-4ca1-aaeb-365a3cdb1a6e service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] No waiting events found dispatching network-vif-plugged-81437106-cc33-4c4b-ac7f-98d2393c84dc {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:49:42 user nova-compute[71711]: WARNING nova.compute.manager [req-5238e640-35fa-4879-be17-45ee92c35453 req-64cc6709-3143-4ca1-aaeb-365a3cdb1a6e service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Received unexpected event network-vif-plugged-81437106-cc33-4c4b-ac7f-98d2393c84dc for instance with vm_state building and task_state spawning.
Apr 12 06:49:42 user nova-compute[71711]: INFO nova.compute.manager [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Took 15.54 seconds to build instance.
Apr 12 06:49:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-83341e98-4f4d-4f2c-a902-15da86381603 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "755c4de9-18c0-457d-b834-d21aab2141a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.634s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-changed-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:49:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Refreshing instance network info cache due to event network-changed-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:49:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] Acquiring lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:49:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] Acquired lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:49:43 user nova-compute[71711]: DEBUG nova.network.neutron [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Refreshing network info cache for port 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:49:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:44 user nova-compute[71711]: DEBUG nova.network.neutron [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updated VIF entry in instance network info cache for port 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:49:44 user nova-compute[71711]: DEBUG nova.network.neutron [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updating instance_info_cache with network_info: [{"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:49:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c48987ce-fee1-48ba-8a4b-5d2e4821ae44 req-f5719ab9-a97a-4895-98ee-a0e27c54d460 service nova] Releasing lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:49:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:46 user nova-compute[71711]: INFO nova.compute.manager [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Rebooting instance
Apr 12 06:49:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:49:46 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquired lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:49:46 user nova-compute[71711]: DEBUG nova.network.neutron [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:49:47 user nova-compute[71711]: DEBUG nova.network.neutron [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updating instance_info_cache with network_info: [{"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:49:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Releasing lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:49:47 user nova-compute[71711]: DEBUG nova.compute.manager [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:49:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:47 user nova-compute[71711]: DEBUG nova.compute.manager [req-436712ca-89ba-44c0-bcea-87918b26587b req-4ddf3029-2547-4a91-a24f-294d917be360 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-vif-unplugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:49:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-436712ca-89ba-44c0-bcea-87918b26587b req-4ddf3029-2547-4a91-a24f-294d917be360 service nova] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-436712ca-89ba-44c0-bcea-87918b26587b req-4ddf3029-2547-4a91-a24f-294d917be360 service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:47 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-436712ca-89ba-44c0-bcea-87918b26587b req-4ddf3029-2547-4a91-a24f-294d917be360 service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:47 user nova-compute[71711]: DEBUG nova.compute.manager [req-436712ca-89ba-44c0-bcea-87918b26587b req-4ddf3029-2547-4a91-a24f-294d917be360 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] No waiting events found dispatching network-vif-unplugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:49:47 user nova-compute[71711]: WARNING nova.compute.manager [req-436712ca-89ba-44c0-bcea-87918b26587b req-4ddf3029-2547-4a91-a24f-294d917be360 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received unexpected event network-vif-unplugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 06:49:48 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 1d45a146-795c-455e-be0f-93227183720a] Instance destroyed successfully.
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.objects.instance [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'resources' on Instance uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1404205967',display_name='tempest-TestMinimumBasicScenario-server-1404205967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1404205967',id=39,image_ref='bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYd1vxt6IOrCuDq8XQobzqeuQGl6sxwoZi2oqGAmYsaM1r02sLjpGCkffLXipByEs9yCp4tNOTiJcnVwggG5nCwVGjhlV6IvXoxSNHVUegrF0R0F2o1Aem8cawIyFgPFQ==',key_name='tempest-TestMinimumBasicScenario-1175210425',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:47:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1aacffb9fbd4398b98db1f1945138dc',ramdisk_id='',reservation_id='r-n0fts2f6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1474504992',owner_user_name='tempest-TestMinimumBasicScenario-1474504992-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:49:47Z,user_data=None,user_id='2a188723ace3460792ed32d13bfe0d93',uuid=1d45a146-795c-455e-be0f-93227183720a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converting VIF {"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_vif [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37cc833c-e2, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:49:48 user nova-compute[71711]: INFO os_vif [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2')
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtjuFhmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:49:48 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cc9c8f-0ccc-4349-aba3-b8d7bca4076c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:49:48 user nova-compute[71711]: No targets found.
Apr 12 06:49:48 user nova-compute[71711]: iSNS:
Apr 12 06:49:48 user nova-compute[71711]: No targets found.
Apr 12 06:49:48 user nova-compute[71711]: STATIC:
Apr 12 06:49:48 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5
Apr 12 06:49:48 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:49:48 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:49:48 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af
Apr 12 06:49:48 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:49:48 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:49:48 user nova-compute[71711]: FIRMWARE:
Apr 12 06:49:48 user nova-compute[71711]: No targets found.
Apr 12 06:49:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:49:48 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:49:48 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bb8c3a-b2e4-424b-833d-c32cb887f029]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[25493871-6742-40ed-8171-4d51aff45b09]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:49:48 user nova-compute[71711]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:49:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:49:48 user nova-compute[71711]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:49:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f99542db0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5'): ({'sdb'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Removing single pathed devices sdb {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0490e2c6-6134-4d17-9ff6-e169f676e0cd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d96fcd4-64a2-4b60-8d5f-1a8f6a4b37e8]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Flushing IO for device /dev/sdb {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5f9f2e-8b56-4be2-a8d1-87d080860260]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b31059a-1af3-4fd3-bfb6-9ff375817d0f]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad464978-11cf-4926-b95c-99830554f349]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f20af8-ff52-49d4-8d06-958f09e216ae]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260]
Apr 12 06:49:48 user nova-compute[71711]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260] successful.
Apr 12 06:49:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6116f41-9ff3-425f-9180-7b6288c47618]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] <== disconnect_volume: return (294ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Start _get_guest_xml network_info=[{"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtjuFhmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1d45a146-795c-455e-be0f-93227183720a', 'attached_at': '', 'detached_at': '', 'volume_id': 'e07c955b-abdd-446f-9137-d12aef35b2c5', 'serial': 'e07c955b-abdd-446f-9137-d12aef35b2c5'}, 'attachment_id': '8be0b98d-dfeb-4bd5-94bb-8864d4c51c4f', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:49:48 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:49:48 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.objects.instance [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtjuFhmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:49:48 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:49:48 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:49:48 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f352bbc6-5cf0-41b6-81d5-4326b0b43761]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:49:48 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d44e2ca-61a4-46e7-ab92-79931a80f6f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5] added
Apr 12 06:49:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f6c5cc-19ec-49a5-ad6a-647caa08d22a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3708ab8-f458-4d9f-a854-93d970fb0165]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtjuFhmD {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtjuFhmD" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ffbb23-8ec3-4512-b042-12a039dbe9f8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UtjuFhmD'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a643bc8-390b-4ab9-9df8-110de538088a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f91a560-9ba5-424a-b21a-d30912aa8c15]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:49:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:49:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1937696-16c6-4afa-b08b-6f5e76140bfb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260]
Apr 12 06:49:48 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260] successful.
Apr 12 06:49:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[924f87e0-c614-4ecb-a4ac-b8390795a449]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9e12c7-29ab-4002-abcf-835462793ecb]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:49:48 user nova-compute[71711]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:49:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:49:48 user nova-compute[71711]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:49:48 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92c172c-bf1b-40ca-b02a-8e72c7439425]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:49:48 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-2c396345-8bf1-4418-92a8-aa5de3e70b57 req-dd6446a5-c354-40b7-8214-a47cdfc61998 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2c396345-8bf1-4418-92a8-aa5de3e70b57 req-dd6446a5-c354-40b7-8214-a47cdfc61998 service nova] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2c396345-8bf1-4418-92a8-aa5de3e70b57 req-dd6446a5-c354-40b7-8214-a47cdfc61998 service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2c396345-8bf1-4418-92a8-aa5de3e70b57 req-dd6446a5-c354-40b7-8214-a47cdfc61998 service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-2c396345-8bf1-4418-92a8-aa5de3e70b57 req-dd6446a5-c354-40b7-8214-a47cdfc61998 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] No waiting events found dispatching network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:49:49 user nova-compute[71711]: WARNING nova.compute.manager [req-2c396345-8bf1-4418-92a8-aa5de3e70b57 req-dd6446a5-c354-40b7-8214-a47cdfc61998 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received unexpected event network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 06:49:49 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtjuFhmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26163646133646236', 'path': '/dev/sdb'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163646133646236', 'path': '/dev/sdb'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1404205967',display_name='tempest-TestMinimumBasicScenario-server-1404205967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1404205967',id=39,image_ref='bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYd1vxt6IOrCuDq8XQobzqeuQGl6sxwoZi2oqGAmYsaM1r02sLjpGCkffLXipByEs9yCp4tNOTiJcnVwggG5nCwVGjhlV6IvXoxSNHVUegrF0R0F2o1Aem8cawIyFgPFQ==',key_name='tempest-TestMinimumBasicScenario-1175210425',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:47:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1aacffb9fbd4398b98db1f1945138dc',ramdisk_id='',reservation_id='r-n0fts2f6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1474504992',owner_user_name='tempest-TestMinimumBasicScenario-1474504992-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:49:47Z,user_data=None,user_id='2a188723ace3460792ed32d13bfe0d93',uuid=1d45a146-795c-455e-be0f-93227183720a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converting VIF {"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG nova.objects.instance [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:49:49 user nova-compute[71711]:   <uuid>1d45a146-795c-455e-be0f-93227183720a</uuid>
Apr 12 06:49:49 user nova-compute[71711]:   <name>instance-00000027</name>
Apr 12 06:49:49 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:49:49 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:49:49 user nova-compute[71711]:   <metadata>
Apr 12 06:49:49 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:49:49 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:49:49 user nova-compute[71711]:       <nova:name>tempest-TestMinimumBasicScenario-server-1404205967</nova:name>
Apr 12 06:49:49 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:49:48</nova:creationTime>
Apr 12 06:49:49 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:49:49 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:49:49 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:49:49 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:49:49 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:49:49 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:49:49 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:49:49 user nova-compute[71711]:       <nova:owner>
Apr 12 06:49:49 user nova-compute[71711]:         <nova:user uuid="2a188723ace3460792ed32d13bfe0d93">tempest-TestMinimumBasicScenario-1474504992-project-member</nova:user>
Apr 12 06:49:49 user nova-compute[71711]:         <nova:project uuid="d1aacffb9fbd4398b98db1f1945138dc">tempest-TestMinimumBasicScenario-1474504992</nova:project>
Apr 12 06:49:49 user nova-compute[71711]:       </nova:owner>
Apr 12 06:49:49 user nova-compute[71711]:       <nova:root type="image" uuid="bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9"/>
Apr 12 06:49:49 user nova-compute[71711]:       <nova:ports>
Apr 12 06:49:49 user nova-compute[71711]:         <nova:port uuid="37cc833c-e20d-4d31-9ecf-389dc5e2f2d6">
Apr 12 06:49:49 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 06:49:49 user nova-compute[71711]:         </nova:port>
Apr 12 06:49:49 user nova-compute[71711]:       </nova:ports>
Apr 12 06:49:49 user nova-compute[71711]:     </nova:instance>
Apr 12 06:49:49 user nova-compute[71711]:   </metadata>
Apr 12 06:49:49 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:49:49 user nova-compute[71711]:     <system>
Apr 12 06:49:49 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:49:49 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:49:49 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:49:49 user nova-compute[71711]:       <entry name="serial">1d45a146-795c-455e-be0f-93227183720a</entry>
Apr 12 06:49:49 user nova-compute[71711]:       <entry name="uuid">1d45a146-795c-455e-be0f-93227183720a</entry>
Apr 12 06:49:49 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:49:49 user nova-compute[71711]:     </system>
Apr 12 06:49:49 user nova-compute[71711]:   </sysinfo>
Apr 12 06:49:49 user nova-compute[71711]:   <os>
Apr 12 06:49:49 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:49:49 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:49:49 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:49:49 user nova-compute[71711]:   </os>
Apr 12 06:49:49 user nova-compute[71711]:   <features>
Apr 12 06:49:49 user nova-compute[71711]:     <acpi/>
Apr 12 06:49:49 user nova-compute[71711]:     <apic/>
Apr 12 06:49:49 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:49:49 user nova-compute[71711]:   </features>
Apr 12 06:49:49 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:49:49 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:49:49 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:49:49 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:49:49 user nova-compute[71711]:   </clock>
Apr 12 06:49:49 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:49:49 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:49:49 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:49:49 user nova-compute[71711]:   </cpu>
Apr 12 06:49:49 user nova-compute[71711]:   <devices>
Apr 12 06:49:49 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:49:49 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:49:49 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk"/>
Apr 12 06:49:49 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:49:49 user nova-compute[71711]:     </disk>
Apr 12 06:49:49 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:49:49 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:49:49 user nova-compute[71711]:       <source dev="/dev/sdb"/>
Apr 12 06:49:49 user nova-compute[71711]:       <target dev="vdb" bus="virtio"/>
Apr 12 06:49:49 user nova-compute[71711]:       <serial>e07c955b-abdd-446f-9137-d12aef35b2c5</serial>
Apr 12 06:49:49 user nova-compute[71711]:     </disk>
Apr 12 06:49:49 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:49:49 user nova-compute[71711]:       <mac address="fa:16:3e:b4:ca:39"/>
Apr 12 06:49:49 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:49:49 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:49:49 user nova-compute[71711]:       <target dev="tap37cc833c-e2"/>
Apr 12 06:49:49 user nova-compute[71711]:     </interface>
Apr 12 06:49:49 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:49:49 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/console.log" append="off"/>
Apr 12 06:49:49 user nova-compute[71711]:     </serial>
Apr 12 06:49:49 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:49:49 user nova-compute[71711]:     <video>
Apr 12 06:49:49 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:49:49 user nova-compute[71711]:     </video>
Apr 12 06:49:49 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:49:49 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:49:49 user nova-compute[71711]:     </rng>
Apr 12 06:49:49 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:49:49 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:49:49 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:49:49 user nova-compute[71711]:     </memballoon>
Apr 12 06:49:49 user nova-compute[71711]:   </devices>
Apr 12 06:49:49 user nova-compute[71711]: </domain>
Apr 12 06:49:49 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:49:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG nova.objects.instance [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Cannot resize image /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG nova.objects.instance [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'migration_context' on Instance uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1404205967',display_name='tempest-TestMinimumBasicScenario-server-1404205967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1404205967',id=39,image_ref='bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYd1vxt6IOrCuDq8XQobzqeuQGl6sxwoZi2oqGAmYsaM1r02sLjpGCkffLXipByEs9yCp4tNOTiJcnVwggG5nCwVGjhlV6IvXoxSNHVUegrF0R0F2o1Aem8cawIyFgPFQ==',key_name='tempest-TestMinimumBasicScenario-1175210425',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:47:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='d1aacffb9fbd4398b98db1f1945138dc',ramdisk_id='',reservation_id='r-n0fts2f6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1474504992',owner_user_name='tempest-TestMinimumBasicScenario-1474504992-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:49:47Z,user_data=None,user_id='2a188723ace3460792ed32d13bfe0d93',uuid=1d45a146-795c-455e-be0f-93227183720a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converting VIF {"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG os_vif [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37cc833c-e2, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37cc833c-e2, col_values=(('external_ids', {'iface-id': '37cc833c-e20d-4d31-9ecf-389dc5e2f2d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:ca:39', 'vm-uuid': '1d45a146-795c-455e-be0f-93227183720a'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:49:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:50 user nova-compute[71711]: INFO os_vif [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2')
Apr 12 06:49:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:52 user nova-compute[71711]: DEBUG nova.compute.manager [req-6502240b-2463-4fde-b910-c7de2890b4ac req-8305a2ba-9b20-414b-8293-8179ccca2516 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:49:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6502240b-2463-4fde-b910-c7de2890b4ac req-8305a2ba-9b20-414b-8293-8179ccca2516 service nova] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6502240b-2463-4fde-b910-c7de2890b4ac req-8305a2ba-9b20-414b-8293-8179ccca2516 service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-6502240b-2463-4fde-b910-c7de2890b4ac req-8305a2ba-9b20-414b-8293-8179ccca2516 service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:52 user nova-compute[71711]: DEBUG nova.compute.manager [req-6502240b-2463-4fde-b910-c7de2890b4ac req-8305a2ba-9b20-414b-8293-8179ccca2516 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] No waiting events found dispatching network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:49:52 user nova-compute[71711]: WARNING nova.compute.manager [req-6502240b-2463-4fde-b910-c7de2890b4ac req-8305a2ba-9b20-414b-8293-8179ccca2516 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received unexpected event network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 06:49:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for 1d45a146-795c-455e-be0f-93227183720a due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:49:54 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282194.0235155, 1d45a146-795c-455e-be0f-93227183720a => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:49:54 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] VM Resumed (Lifecycle Event)
Apr 12 06:49:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:49:54 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 1d45a146-795c-455e-be0f-93227183720a] Instance rebooted successfully.
Apr 12 06:49:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:49:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:49:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:49:54 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 12 06:49:54 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282194.0252447, 1d45a146-795c-455e-be0f-93227183720a => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:49:54 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] VM Started (Lifecycle Event)
Apr 12 06:49:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:49:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:49:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-edf16e35-8852-4bfa-894e-0c741f8d1f82 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.699s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-1c91e5ca-01fc-4dcb-af7d-d43ab6dd2f0d req-d8f34b64-0be0-44ba-b511-5c58891a7f2e service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:49:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1c91e5ca-01fc-4dcb-af7d-d43ab6dd2f0d req-d8f34b64-0be0-44ba-b511-5c58891a7f2e service nova] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:49:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1c91e5ca-01fc-4dcb-af7d-d43ab6dd2f0d req-d8f34b64-0be0-44ba-b511-5c58891a7f2e service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:49:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1c91e5ca-01fc-4dcb-af7d-d43ab6dd2f0d req-d8f34b64-0be0-44ba-b511-5c58891a7f2e service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:49:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-1c91e5ca-01fc-4dcb-af7d-d43ab6dd2f0d req-d8f34b64-0be0-44ba-b511-5c58891a7f2e service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] No waiting events found dispatching network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:49:54 user nova-compute[71711]: WARNING nova.compute.manager [req-1c91e5ca-01fc-4dcb-af7d-d43ab6dd2f0d req-d8f34b64-0be0-44ba-b511-5c58891a7f2e service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received unexpected event network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance with vm_state active and task_state None.
Apr 12 06:49:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:49:57 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:49:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:02 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:50:03 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:50:04 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:50:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:50:06 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:50:08 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updating instance_info_cache with network_info: [{"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:50:10 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:50:10 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:50:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8536MB free_disk=26.147777557373047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:50:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:50:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:50:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 1d45a146-795c-455e-be0f-93227183720a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:50:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 755c4de9-18c0-457d-b834-d21aab2141a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:50:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:50:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:50:10 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:50:10 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:50:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:50:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:50:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:50:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "02209375-f25a-4d51-9828-3422144c2ed8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:50:29 user nova-compute[71711]: INFO nova.compute.manager [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Unshelving
Apr 12 06:50:29 user nova-compute[71711]: INFO nova.virt.block_device [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Booting with volume 9cbbb1a6-c094-4a11-beef-499b756020f2 at /dev/vdc
Apr 12 06:50:29 user nova-compute[71711]: DEBUG os_brick.utils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3881eea2-f030-4154-83ec-534d7224ba2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad5e58a-03c1-410b-b0e1-2598e635fe2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5bfc57-e312-4561-bfeb-b3f52cf787e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b297787-4bb8-4820-9763-4e6f56e486d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:50:29 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:50:29 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0ce266-810f-420b-8f94-ca86dd31aa58]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG os_brick.utils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updating existing volume attachment record: 7ba3716d-63c3-4558-b567-2ebd73168dc9 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:50:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:50:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:50:34 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'pci_requests' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:50:34 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'numa_topology' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:50:34 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:50:34 user nova-compute[71711]: INFO nova.compute.claims [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Claim successful on node user
Apr 12 06:50:34 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:50:34 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:50:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:50:34 user nova-compute[71711]: INFO nova.network.neutron [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updating port e6c75186-26c0-414f-9dfe-13cb03283057 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquired lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-changed-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Refreshing instance network info cache due to event network-changed-e6c75186-26c0-414f-9dfe-13cb03283057. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] Acquiring lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG nova.network.neutron [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updating instance_info_cache with network_info: [{"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Releasing lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:50:35 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Creating image(s)
Apr 12 06:50:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "/opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "/opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "/opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'trusted_certs' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] Acquired lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG nova.network.neutron [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Refreshing network info cache for port e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "4e48b19575c3c0adca8facff711d4fcda1b71071" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:50:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "4e48b19575c3c0adca8facff711d4fcda1b71071" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:50:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071.part --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071.part --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:36 user nova-compute[71711]: DEBUG nova.virt.images [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] 3230c0bb-d5de-4913-80ad-dbfd5fcd5478 was qcow2, converting to raw {{(pid=71711) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 06:50:36 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:50:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071.part /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071.converted {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:36 user nova-compute[71711]: DEBUG nova.network.neutron [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updated VIF entry in instance network info cache for port e6c75186-26c0-414f-9dfe-13cb03283057. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:50:36 user nova-compute[71711]: DEBUG nova.network.neutron [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updating instance_info_cache with network_info: [{"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:50:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3e7df6ab-5989-454c-9a78-c9b60e97afba req-be434a95-e4dd-43c1-92c7-0fb7ecbec8ca service nova] Releasing lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071.part /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071.converted" returned: 0 in 0.550s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071.converted --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "4e48b19575c3c0adca8facff711d4fcda1b71071" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.646s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071 --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "4e48b19575c3c0adca8facff711d4fcda1b71071" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "4e48b19575c3c0adca8facff711d4fcda1b71071" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071 --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071,backing_fmt=raw /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071,backing_fmt=raw /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk 1073741824" returned: 0 in 0.055s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "4e48b19575c3c0adca8facff711d4fcda1b71071" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071 --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'migration_context' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:50:37 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Rebasing disk image.
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:37 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 -F raw /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 -F raw /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk" returned: 0 in 1.931s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Ensure instance console log exists: /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Start _get_guest_xml network_info=[{"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='cf198be1c096ad99a54e534db22d00c5',container_format='bare',created_at=2023-04-12T06:48:37Z,direct_url=<?>,disk_format='qcow2',id=3230c0bb-d5de-4913-80ad-dbfd5fcd5478,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2020171009-shelved',owner='76a8460ce5c24d1db20e80a1659133f7',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T06:48:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMCckQRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '02209375-f25a-4d51-9828-3422144c2ed8', 'attached_at': '', 'detached_at': '', 'volume_id': '9cbbb1a6-c094-4a11-beef-499b756020f2', 'serial': '9cbbb1a6-c094-4a11-beef-499b756020f2'}, 'attachment_id': '7ba3716d-63c3-4558-b567-2ebd73168dc9', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:50:39 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:50:39 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cf198be1c096ad99a54e534db22d00c5',container_format='bare',created_at=2023-04-12T06:48:37Z,direct_url=<?>,disk_format='qcow2',id=3230c0bb-d5de-4913-80ad-dbfd5fcd5478,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2020171009-shelved',owner='76a8460ce5c24d1db20e80a1659133f7',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T06:48:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'vcpu_model' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMCckQRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:50:39 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:50:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:50:39 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:50:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:50:39 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c081e6-dfbd-44b0-9e31-97b4f86877ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:50:39 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eba4cb-51c7-4155-8451-ed32da94a5b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2] added
Apr 12 06:50:39 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[41444a78-42a5-4db7-b654-acb2b097f7f8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[89562f5d-c34e-466f-a60b-c73aaa984077]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMCckQRL {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMCckQRL" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ba432-1fad-4f4d-964a-9d81ceb5f0c8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMCckQRL'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:50:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[df10d3b1-aa61-4343-a459-a882ff6b3ece]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9edef5-97cd-41a0-9af3-8c41e2661009]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:50:40 user nova-compute[71711]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:50:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:50:40 user nova-compute[71711]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:50:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[123a183b-f962-4313-b281-b8778483c8f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2, portal: 172.16.0.220,3260]
Apr 12 06:50:40 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2, portal: 172.16.0.220,3260] successful.
Apr 12 06:50:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[04906f3e-c15e-4bc3-97b8-03bcd7e486d9]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d1e286-bfef-4651-944c-bb2a6a5f03fb]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:50:40 user nova-compute[71711]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:50:40 user nova-compute[71711]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 (non-flash)
Apr 12 06:50:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:50:40 user nova-compute[71711]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:50:40 user nova-compute[71711]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 (non-flash)
Apr 12 06:50:40 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[305590bb-b88f-4aa4-ae7b-7ab62926e8ec]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:50:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMCckQRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23434346164366238', 'path': '/dev/sdd'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434346164366238', 'path': '/dev/sdd'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2020171009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2020171009',id=38,image_ref='3230c0bb-d5de-4913-80ad-dbfd5fcd5478',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-914952928',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:46:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='76a8460ce5c24d1db20e80a1659133f7',ramdisk_id='',reservation_id='r-5iy62es8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1986658224',owner_user_name='tempest-AttachVolumeShelveTestJSON-1986658224-project-member',shelved_at='2023-04-12T06:48:40.563413',shelved_host='user',shelved_image_id='3230c0bb-d5de-4913-80ad-dbfd5fcd5478'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fbb8c37e5a74a0b83011c2a21033204',uuid=02209375-f25a-4d51-9828-3422144c2ed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converting VIF {"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG nova.objects.instance [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'pci_devices' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:50:41 user nova-compute[71711]:   <uuid>02209375-f25a-4d51-9828-3422144c2ed8</uuid>
Apr 12 06:50:41 user nova-compute[71711]:   <name>instance-00000026</name>
Apr 12 06:50:41 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:50:41 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:50:41 user nova-compute[71711]:   <metadata>
Apr 12 06:50:41 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:50:41 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:50:41 user nova-compute[71711]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2020171009</nova:name>
Apr 12 06:50:41 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:50:39</nova:creationTime>
Apr 12 06:50:41 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:50:41 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:50:41 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:50:41 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:50:41 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:50:41 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:50:41 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:50:41 user nova-compute[71711]:       <nova:owner>
Apr 12 06:50:41 user nova-compute[71711]:         <nova:user uuid="4fbb8c37e5a74a0b83011c2a21033204">tempest-AttachVolumeShelveTestJSON-1986658224-project-member</nova:user>
Apr 12 06:50:41 user nova-compute[71711]:         <nova:project uuid="76a8460ce5c24d1db20e80a1659133f7">tempest-AttachVolumeShelveTestJSON-1986658224</nova:project>
Apr 12 06:50:41 user nova-compute[71711]:       </nova:owner>
Apr 12 06:50:41 user nova-compute[71711]:       <nova:root type="image" uuid="3230c0bb-d5de-4913-80ad-dbfd5fcd5478"/>
Apr 12 06:50:41 user nova-compute[71711]:       <nova:ports>
Apr 12 06:50:41 user nova-compute[71711]:         <nova:port uuid="e6c75186-26c0-414f-9dfe-13cb03283057">
Apr 12 06:50:41 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 06:50:41 user nova-compute[71711]:         </nova:port>
Apr 12 06:50:41 user nova-compute[71711]:       </nova:ports>
Apr 12 06:50:41 user nova-compute[71711]:     </nova:instance>
Apr 12 06:50:41 user nova-compute[71711]:   </metadata>
Apr 12 06:50:41 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:50:41 user nova-compute[71711]:     <system>
Apr 12 06:50:41 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:50:41 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:50:41 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:50:41 user nova-compute[71711]:       <entry name="serial">02209375-f25a-4d51-9828-3422144c2ed8</entry>
Apr 12 06:50:41 user nova-compute[71711]:       <entry name="uuid">02209375-f25a-4d51-9828-3422144c2ed8</entry>
Apr 12 06:50:41 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:50:41 user nova-compute[71711]:     </system>
Apr 12 06:50:41 user nova-compute[71711]:   </sysinfo>
Apr 12 06:50:41 user nova-compute[71711]:   <os>
Apr 12 06:50:41 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:50:41 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:50:41 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:50:41 user nova-compute[71711]:   </os>
Apr 12 06:50:41 user nova-compute[71711]:   <features>
Apr 12 06:50:41 user nova-compute[71711]:     <acpi/>
Apr 12 06:50:41 user nova-compute[71711]:     <apic/>
Apr 12 06:50:41 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:50:41 user nova-compute[71711]:   </features>
Apr 12 06:50:41 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:50:41 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:50:41 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:50:41 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:50:41 user nova-compute[71711]:   </clock>
Apr 12 06:50:41 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:50:41 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:50:41 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:50:41 user nova-compute[71711]:   </cpu>
Apr 12 06:50:41 user nova-compute[71711]:   <devices>
Apr 12 06:50:41 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:50:41 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:50:41 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk"/>
Apr 12 06:50:41 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:50:41 user nova-compute[71711]:     </disk>
Apr 12 06:50:41 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:50:41 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:50:41 user nova-compute[71711]:       <source dev="/dev/sdd"/>
Apr 12 06:50:41 user nova-compute[71711]:       <target dev="vdc" bus="virtio"/>
Apr 12 06:50:41 user nova-compute[71711]:       <serial>9cbbb1a6-c094-4a11-beef-499b756020f2</serial>
Apr 12 06:50:41 user nova-compute[71711]:     </disk>
Apr 12 06:50:41 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:50:41 user nova-compute[71711]:       <mac address="fa:16:3e:03:ee:ad"/>
Apr 12 06:50:41 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:50:41 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:50:41 user nova-compute[71711]:       <target dev="tape6c75186-26"/>
Apr 12 06:50:41 user nova-compute[71711]:     </interface>
Apr 12 06:50:41 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:50:41 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/console.log" append="off"/>
Apr 12 06:50:41 user nova-compute[71711]:     </serial>
Apr 12 06:50:41 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:50:41 user nova-compute[71711]:     <video>
Apr 12 06:50:41 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:50:41 user nova-compute[71711]:     </video>
Apr 12 06:50:41 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:50:41 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:50:41 user nova-compute[71711]:     </rng>
Apr 12 06:50:41 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:50:41 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:50:41 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:50:41 user nova-compute[71711]:     </memballoon>
Apr 12 06:50:41 user nova-compute[71711]:   </devices>
Apr 12 06:50:41 user nova-compute[71711]: </domain>
Apr 12 06:50:41 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2020171009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2020171009',id=38,image_ref='3230c0bb-d5de-4913-80ad-dbfd5fcd5478',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-914952928',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:46:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='76a8460ce5c24d1db20e80a1659133f7',ramdisk_id='',reservation_id='r-5iy62es8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1986658224',owner_user_name='tempest-AttachVolumeShelveTestJSON-1986658224-project-member',shelved_at='2023-04-12T06:48:40.563413',shelved_host='user',shelved_image_id='3230c0bb-d5de-4913-80ad-dbfd5fcd5478'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fbb8c37e5a74a0b83011c2a21033204',uuid=02209375-f25a-4d51-9828-3422144c2ed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converting VIF {"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG os_vif [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6c75186-26, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6c75186-26, col_values=(('external_ids', {'iface-id': 'e6c75186-26c0-414f-9dfe-13cb03283057', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:ee:ad', 'vm-uuid': '02209375-f25a-4d51-9828-3422144c2ed8'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:41 user nova-compute[71711]: INFO os_vif [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26')
Apr 12 06:50:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:50:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] No VIF found with MAC fa:16:3e:03:ee:ad, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:50:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-aec7e48a-11b4-4aab-ab6d-5fa0b6e576d1 req-59043ae8-53e3-4c16-8bad-faaa78ac91d6 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:50:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-aec7e48a-11b4-4aab-ab6d-5fa0b6e576d1 req-59043ae8-53e3-4c16-8bad-faaa78ac91d6 service nova] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:50:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-aec7e48a-11b4-4aab-ab6d-5fa0b6e576d1 req-59043ae8-53e3-4c16-8bad-faaa78ac91d6 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:50:42 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-aec7e48a-11b4-4aab-ab6d-5fa0b6e576d1 req-59043ae8-53e3-4c16-8bad-faaa78ac91d6 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:50:42 user nova-compute[71711]: DEBUG nova.compute.manager [req-aec7e48a-11b4-4aab-ab6d-5fa0b6e576d1 req-59043ae8-53e3-4c16-8bad-faaa78ac91d6 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] No waiting events found dispatching network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:50:42 user nova-compute[71711]: WARNING nova.compute.manager [req-aec7e48a-11b4-4aab-ab6d-5fa0b6e576d1 req-59043ae8-53e3-4c16-8bad-faaa78ac91d6 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received unexpected event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 06:50:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:44 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282244.7008827, 02209375-f25a-4d51-9828-3422144c2ed8 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:50:44 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] VM Resumed (Lifecycle Event)
Apr 12 06:50:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:50:44 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:50:44 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Instance spawned successfully.
Apr 12 06:50:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:50:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:50:44 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:50:44 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282244.7030478, 02209375-f25a-4d51-9828-3422144c2ed8 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:50:44 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] VM Started (Lifecycle Event)
Apr 12 06:50:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:50:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-1fa69511-a4b3-45de-9d5f-e87bdbff004c req-617ccc72-0521-476d-b09f-33d95deda637 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:50:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1fa69511-a4b3-45de-9d5f-e87bdbff004c req-617ccc72-0521-476d-b09f-33d95deda637 service nova] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:50:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1fa69511-a4b3-45de-9d5f-e87bdbff004c req-617ccc72-0521-476d-b09f-33d95deda637 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:50:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1fa69511-a4b3-45de-9d5f-e87bdbff004c req-617ccc72-0521-476d-b09f-33d95deda637 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:50:44 user nova-compute[71711]: DEBUG nova.compute.manager [req-1fa69511-a4b3-45de-9d5f-e87bdbff004c req-617ccc72-0521-476d-b09f-33d95deda637 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] No waiting events found dispatching network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:50:44 user nova-compute[71711]: WARNING nova.compute.manager [req-1fa69511-a4b3-45de-9d5f-e87bdbff004c req-617ccc72-0521-476d-b09f-33d95deda637 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received unexpected event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 06:50:44 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:50:44 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:50:45 user nova-compute[71711]: DEBUG nova.compute.manager [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:50:45 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-a2007adc-5082-4351-8aef-0217d9e2a293 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "02209375-f25a-4d51-9828-3422144c2ed8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.977s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:50:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:50:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:50:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:50:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:50:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:50:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:50:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:03 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:51:04 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:51:04 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:51:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:51:06 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:51:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:08 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:51:10 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:51:10 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:51:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8567MB free_disk=26.129146575927734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:51:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:51:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:51:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 1d45a146-795c-455e-be0f-93227183720a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:51:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 755c4de9-18c0-457d-b834-d21aab2141a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:51:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 02209375-f25a-4d51-9828-3422144c2ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:51:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:51:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:51:10 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:51:10 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:51:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:51:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:51:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:51:11 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:51:11 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:51:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:51:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-755c4de9-18c0-457d-b834-d21aab2141a8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:51:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-755c4de9-18c0-457d-b834-d21aab2141a8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:51:11 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:51:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Updating instance_info_cache with network_info: [{"id": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "address": "fa:16:3e:05:33:33", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81437106-cc", "ovs_interfaceid": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:51:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-755c4de9-18c0-457d-b834-d21aab2141a8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:51:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:51:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "755c4de9-18c0-457d-b834-d21aab2141a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:51:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "755c4de9-18c0-457d-b834-d21aab2141a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:51:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:51:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:51:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:51:17 user nova-compute[71711]: INFO nova.compute.manager [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Terminating instance
Apr 12 06:51:17 user nova-compute[71711]: DEBUG nova.compute.manager [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:51:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-f162fe1a-f9d3-4c57-bbe7-753738c2c21e req-48693c77-06af-423a-aa24-b08b3ecd47b0 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Received event network-vif-unplugged-81437106-cc33-4c4b-ac7f-98d2393c84dc {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f162fe1a-f9d3-4c57-bbe7-753738c2c21e req-48693c77-06af-423a-aa24-b08b3ecd47b0 service nova] Acquiring lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f162fe1a-f9d3-4c57-bbe7-753738c2c21e req-48693c77-06af-423a-aa24-b08b3ecd47b0 service nova] Lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f162fe1a-f9d3-4c57-bbe7-753738c2c21e req-48693c77-06af-423a-aa24-b08b3ecd47b0 service nova] Lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-f162fe1a-f9d3-4c57-bbe7-753738c2c21e req-48693c77-06af-423a-aa24-b08b3ecd47b0 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] No waiting events found dispatching network-vif-unplugged-81437106-cc33-4c4b-ac7f-98d2393c84dc {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-f162fe1a-f9d3-4c57-bbe7-753738c2c21e req-48693c77-06af-423a-aa24-b08b3ecd47b0 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Received event network-vif-unplugged-81437106-cc33-4c4b-ac7f-98d2393c84dc for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:51:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Instance destroyed successfully.
Apr 12 06:51:18 user nova-compute[71711]: DEBUG nova.objects.instance [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lazy-loading 'resources' on Instance uuid 755c4de9-18c0-457d-b834-d21aab2141a8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:49:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-86781039',display_name='tempest-TestVolumeBootPattern-server-86781039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-86781039',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-44aavoj9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:49:43Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=755c4de9-18c0-457d-b834-d21aab2141a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "address": "fa:16:3e:05:33:33", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81437106-cc", "ovs_interfaceid": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "address": "fa:16:3e:05:33:33", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81437106-cc", "ovs_interfaceid": "81437106-cc33-4c4b-ac7f-98d2393c84dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:33:33,bridge_name='br-int',has_traffic_filtering=True,id=81437106-cc33-4c4b-ac7f-98d2393c84dc,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81437106-cc') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_vif [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:33:33,bridge_name='br-int',has_traffic_filtering=True,id=81437106-cc33-4c4b-ac7f-98d2393c84dc,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81437106-cc') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81437106-cc, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:51:18 user nova-compute[71711]: INFO os_vif [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:33:33,bridge_name='br-int',has_traffic_filtering=True,id=81437106-cc33-4c4b-ac7f-98d2393c84dc,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81437106-cc')
Apr 12 06:51:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgDfYWth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:51:18 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8259a7eb-f532-4b7b-b46c-fd7f02b767e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:51:18 user nova-compute[71711]: No targets found.
Apr 12 06:51:18 user nova-compute[71711]: iSNS:
Apr 12 06:51:18 user nova-compute[71711]: No targets found.
Apr 12 06:51:18 user nova-compute[71711]: STATIC:
Apr 12 06:51:18 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5
Apr 12 06:51:18 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:51:18 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:51:18 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2
Apr 12 06:51:18 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:51:18 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:51:18 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af
Apr 12 06:51:18 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:51:18 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:51:18 user nova-compute[71711]: FIRMWARE:
Apr 12 06:51:18 user nova-compute[71711]: No targets found.
Apr 12 06:51:18 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:51:18 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:51:18 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0865f85d-9601-43a0-b0b3-ebedc8987c4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4a7853-89fa-4c2e-8fee-43a53d7bd5a8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:51:18 user nova-compute[71711]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:51:18 user nova-compute[71711]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 (non-flash)
Apr 12 06:51:18 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af (non-flash)
Apr 12 06:51:18 user nova-compute[71711]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:51:18 user nova-compute[71711]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 (non-flash)
Apr 12 06:51:18 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c141c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af'): ({'sdc'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Removing single pathed devices sdc {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc665bd-c3bc-4014-9dbb-29f18074f81d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c7ffb1-f5eb-4b63-8418-1f71eaede65c]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flushing IO for device /dev/sdc {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac02c01-0bd4-4b55-be9a-6b1af688a715]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb7d683-2fae-4410-a830-13ac48391211]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e422a32-1ce5-48d7-8b63-92abb6be3b00]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc62efa-d886-4c1c-81f0-7ac6c94f56f6]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af, portal: 172.16.0.220,3260]
Apr 12 06:51:18 user nova-compute[71711]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af, portal: 172.16.0.220,3260] successful.
Apr 12 06:51:18 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b554b9-110c-4f1f-9fe6-a30e2120f7af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1073ea9d-b8db-4e75-b432-72966d54bed1]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== disconnect_volume: return (319ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:51:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Deleting instance files /opt/stack/data/nova/instances/755c4de9-18c0-457d-b834-d21aab2141a8_del
Apr 12 06:51:18 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Deletion of /opt/stack/data/nova/instances/755c4de9-18c0-457d-b834-d21aab2141a8_del complete
Apr 12 06:51:18 user nova-compute[71711]: INFO nova.compute.manager [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 12 06:51:18 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:51:18 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:51:19 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:51:19 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Took 0.49 seconds to deallocate network for instance.
Apr 12 06:51:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Received event network-vif-plugged-81437106-cc33-4c4b-ac7f-98d2393c84dc {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:51:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] Acquiring lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:51:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] Lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:51:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] Lock "755c4de9-18c0-457d-b834-d21aab2141a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:51:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] No waiting events found dispatching network-vif-plugged-81437106-cc33-4c4b-ac7f-98d2393c84dc {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:51:20 user nova-compute[71711]: WARNING nova.compute.manager [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Received unexpected event network-vif-plugged-81437106-cc33-4c4b-ac7f-98d2393c84dc for instance with vm_state active and task_state deleting.
Apr 12 06:51:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-3adfe496-3938-4241-9ed1-1324b8c3d5a7 req-9faa56a8-3494-4f57-9eea-cad7b4dd4db4 service nova] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Received event network-vif-deleted-81437106-cc33-4c4b-ac7f-98d2393c84dc {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:51:20 user nova-compute[71711]: INFO nova.compute.manager [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Took 0.83 seconds to detach 1 volumes for instance.
Apr 12 06:51:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Deleting volume: a5b554b9-110c-4f1f-9fe6-a30e2120f7af {{(pid=71711) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 06:51:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:51:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:51:20 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:51:20 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:51:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:51:20 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Deleted allocations for instance 755c4de9-18c0-457d-b834-d21aab2141a8
Apr 12 06:51:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-72ebe517-bb76-4a76-b2c5-448a6c345c0b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "755c4de9-18c0-457d-b834-d21aab2141a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.898s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:51:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:33 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681282278.3987842, 755c4de9-18c0-457d-b834-d21aab2141a8 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:51:33 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] VM Stopped (Lifecycle Event)
Apr 12 06:51:33 user nova-compute[71711]: DEBUG nova.compute.manager [None req-dd93bc51-6734-4616-b64b-475f05cf53e4 None None] [instance: 755c4de9-18c0-457d-b834-d21aab2141a8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:51:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:51:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:51:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:51:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:51:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-changed-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:51:38 user nova-compute[71711]: DEBUG nova.compute.manager [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Refreshing instance network info cache due to event network-changed-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:51:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] Acquiring lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:51:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] Acquired lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:51:38 user nova-compute[71711]: DEBUG nova.network.neutron [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Refreshing network info cache for port 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:51:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:38 user nova-compute[71711]: DEBUG nova.network.neutron [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updated VIF entry in instance network info cache for port 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:51:38 user nova-compute[71711]: DEBUG nova.network.neutron [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updating instance_info_cache with network_info: [{"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:51:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b6f5bc80-05ef-47f2-8fa5-23439793dfab req-03347286-bbf9-4fc8-af77-b1c3a48834f6 service nova] Releasing lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:51:39 user nova-compute[71711]: INFO nova.compute.manager [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Detaching volume e07c955b-abdd-446f-9137-d12aef35b2c5
Apr 12 06:51:39 user nova-compute[71711]: INFO nova.virt.block_device [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Attempting to driver detach volume e07c955b-abdd-446f-9137-d12aef35b2c5 from mountpoint /dev/vdb
Apr 12 06:51:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Attempting to detach device vdb from instance 1d45a146-795c-455e-be0f-93227183720a from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:51:39 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:51:39 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:51:39 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:51:39 user nova-compute[71711]:   <serial>e07c955b-abdd-446f-9137-d12aef35b2c5</serial>
Apr 12 06:51:39 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 06:51:39 user nova-compute[71711]: </disk>
Apr 12 06:51:39 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:51:39 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Successfully detached device vdb from instance 1d45a146-795c-455e-be0f-93227183720a from the persistent domain config.
Apr 12 06:51:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d45a146-795c-455e-be0f-93227183720a from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:51:39 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:51:39 user nova-compute[71711]:   <source dev="/dev/sdb"/>
Apr 12 06:51:39 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:51:39 user nova-compute[71711]:   <serial>e07c955b-abdd-446f-9137-d12aef35b2c5</serial>
Apr 12 06:51:39 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 06:51:39 user nova-compute[71711]: </disk>
Apr 12 06:51:39 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681282299.6879263, 1d45a146-795c-455e-be0f-93227183720a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:51:39 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Successfully detached device vdb from instance 1d45a146-795c-455e-be0f-93227183720a from the live domain config.
Apr 12 06:51:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtjuFhmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:51:39 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3416407-fc8e-47ee-accc-656ec63827ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:51:39 user nova-compute[71711]: No targets found.
Apr 12 06:51:39 user nova-compute[71711]: iSNS:
Apr 12 06:51:39 user nova-compute[71711]: No targets found.
Apr 12 06:51:39 user nova-compute[71711]: STATIC:
Apr 12 06:51:39 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5
Apr 12 06:51:39 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:51:39 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:51:39 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2
Apr 12 06:51:39 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:51:39 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:51:39 user nova-compute[71711]: FIRMWARE:
Apr 12 06:51:39 user nova-compute[71711]: No targets found.
Apr 12 06:51:39 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:51:39 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:51:39 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e10ad66-6eaf-4504-9fd6-21730a3582b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7644de28-dd10-460a-aeaa-5eeda433a283]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:51:39 user nova-compute[71711]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 (non-flash)
Apr 12 06:51:39 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 (non-flash)
Apr 12 06:51:39 user nova-compute[71711]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 (non-flash)
Apr 12 06:51:39 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c141fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5'): ({'sdb'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Removing single pathed devices sdb {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fe3179-5d3d-4895-824e-ec708d903cd5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef2e561-2344-4f75-bbb8-c82639df438a]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Flushing IO for device /dev/sdb {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf79d1e-62e1-43ac-9b37-16fe42e14e2b]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[921e4322-b995-4ada-9de8-7b5e56191702]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a39d2d-087a-4396-b4e6-a9a45daf7750]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1efcee-5df9-42e2-935d-07cda75f7fd8]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260]
Apr 12 06:51:39 user nova-compute[71711]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5, portal: 172.16.0.220,3260] successful.
Apr 12 06:51:39 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:51:39 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e07c955b-abdd-446f-9137-d12aef35b2c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[458af78d-fab7-4898-a9b5-30ec45b03e3e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] <== disconnect_volume: return (314ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-changed-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Refreshing instance network info cache due to event network-changed-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] Acquiring lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] Acquired lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG nova.network.neutron [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Refreshing network info cache for port 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG nova.network.neutron [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updated VIF entry in instance network info cache for port 37cc833c-e20d-4d31-9ecf-389dc5e2f2d6. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG nova.network.neutron [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updating instance_info_cache with network_info: [{"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1851df6d-5e32-4060-a894-fe64d5de3bef req-e2a62ea2-d6c6-474c-ae56-b1d5e405d6a5 service nova] Releasing lock "refresh_cache-1d45a146-795c-455e-be0f-93227183720a" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'flavor' on Instance uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:51:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7e6ebd50-51c2-48e1-8d0b-7f1ddaaaa1d0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.714s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:51:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:51:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:51:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:51:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:51:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:51:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:51:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:51:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:52:04 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:52:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:52:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:52:08 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:52:08 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:52:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:09 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:10 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:52:10 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:52:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8643MB free_disk=26.1279296875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:52:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:52:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:52:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 1d45a146-795c-455e-be0f-93227183720a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:52:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 02209375-f25a-4d51-9828-3422144c2ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:52:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:52:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:52:10 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:52:10 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:52:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:52:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:52:11 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:52:11 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:52:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:52:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:52:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:52:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:52:11 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:52:11 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:52:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updating instance_info_cache with network_info: [{"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:52:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-02209375-f25a-4d51-9828-3422144c2ed8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:52:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:52:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:52:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:52:16 user nova-compute[71711]: INFO nova.compute.claims [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Claim successful on node user
Apr 12 06:52:16 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG nova.network.neutron [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:52:16 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:52:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:52:16 user nova-compute[71711]: INFO nova.virt.block_device [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Booting with volume c94a19e9-963c-4e8e-a613-6fc05da1dce3 at /dev/vda
Apr 12 06:52:16 user nova-compute[71711]: DEBUG os_brick.utils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa199960-93ad-40e2-bae7-9367269f09e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f6be0f-3f92-4a92-90ba-60c1acadd2d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fdf5fb-3cc3-4e4b-9986-8d9d02e0b069]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5301f033-ba27-435a-887b-8da2ca8a44a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:52:16 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:52:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89a546b-4585-44a8-93b2-383c9f5866a6]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG os_brick.utils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:52:16 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Updating existing volume attachment record: 25944eb2-2045-43af-9383-e763b299a0ea {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:52:17 user nova-compute[71711]: DEBUG nova.policy [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:52:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:17 user nova-compute[71711]: DEBUG nova.network.neutron [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Successfully created port: 3d92724c-b271-4ead-a1b5-821d82d0ec85 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG nova.network.neutron [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Successfully updated port: 3d92724c-b271-4ead-a1b5-821d82d0ec85 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "refresh_cache-e13297b8-5f8a-46e8-8793-a092b5b4fc9e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquired lock "refresh_cache-e13297b8-5f8a-46e8-8793-a092b5b4fc9e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG nova.network.neutron [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Received event network-changed-3d92724c-b271-4ead-a1b5-821d82d0ec85 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG nova.compute.manager [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Refreshing instance network info cache due to event network-changed-3d92724c-b271-4ead-a1b5-821d82d0ec85. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] Acquiring lock "refresh_cache-e13297b8-5f8a-46e8-8793-a092b5b4fc9e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG nova.network.neutron [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG nova.network.neutron [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Updating instance_info_cache with network_info: [{"id": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "address": "fa:16:3e:4f:38:76", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d92724c-b2", "ovs_interfaceid": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Releasing lock "refresh_cache-e13297b8-5f8a-46e8-8793-a092b5b4fc9e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Instance network_info: |[{"id": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "address": "fa:16:3e:4f:38:76", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d92724c-b2", "ovs_interfaceid": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] Acquired lock "refresh_cache-e13297b8-5f8a-46e8-8793-a092b5b4fc9e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:52:18 user nova-compute[71711]: DEBUG nova.network.neutron [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Refreshing network info cache for port 3d92724c-b271-4ead-a1b5-821d82d0ec85 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "02209375-f25a-4d51-9828-3422144c2ed8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG nova.network.neutron [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Updated VIF entry in instance network info cache for port 3d92724c-b271-4ead-a1b5-821d82d0ec85. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG nova.network.neutron [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Updating instance_info_cache with network_info: [{"id": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "address": "fa:16:3e:4f:38:76", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d92724c-b2", "ovs_interfaceid": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0775dee2-36db-448c-a1df-f9fe030c52f3 req-bb4c2910-35c7-4277-9246-5b34a0794704 service nova] Releasing lock "refresh_cache-e13297b8-5f8a-46e8-8793-a092b5b4fc9e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:52:19 user nova-compute[71711]: INFO nova.compute.manager [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Detaching volume 9cbbb1a6-c094-4a11-beef-499b756020f2
Apr 12 06:52:19 user nova-compute[71711]: INFO nova.virt.block_device [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Attempting to driver detach volume 9cbbb1a6-c094-4a11-beef-499b756020f2 from mountpoint /dev/vdc
Apr 12 06:52:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Attempting to detach device vdc from instance 02209375-f25a-4d51-9828-3422144c2ed8 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:52:19 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:52:19 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:52:19 user nova-compute[71711]:   <target dev="vdc" bus="virtio"/>
Apr 12 06:52:19 user nova-compute[71711]:   <serial>9cbbb1a6-c094-4a11-beef-499b756020f2</serial>
Apr 12 06:52:19 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 06:52:19 user nova-compute[71711]: </disk>
Apr 12 06:52:19 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:52:19 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Successfully detached device vdc from instance 02209375-f25a-4d51-9828-3422144c2ed8 from the persistent domain config.
Apr 12 06:52:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 02209375-f25a-4d51-9828-3422144c2ed8 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:52:19 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:52:19 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:52:19 user nova-compute[71711]:   <target dev="vdc" bus="virtio"/>
Apr 12 06:52:19 user nova-compute[71711]:   <serial>9cbbb1a6-c094-4a11-beef-499b756020f2</serial>
Apr 12 06:52:19 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 06:52:19 user nova-compute[71711]: </disk>
Apr 12 06:52:19 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681282339.9304786, 02209375-f25a-4d51-9828-3422144c2ed8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:52:19 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Successfully detached device vdc from instance 02209375-f25a-4d51-9828-3422144c2ed8 from the live domain config.
Apr 12 06:52:19 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMCckQRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:52:19 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:52:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[139bf2fe-935b-4716-bbab-3d97aab99cd5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:52:19 user nova-compute[71711]: No targets found.
Apr 12 06:52:19 user nova-compute[71711]: iSNS:
Apr 12 06:52:19 user nova-compute[71711]: No targets found.
Apr 12 06:52:19 user nova-compute[71711]: STATIC:
Apr 12 06:52:19 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2
Apr 12 06:52:19 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:52:19 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:52:19 user nova-compute[71711]: FIRMWARE:
Apr 12 06:52:19 user nova-compute[71711]: No targets found.
Apr 12 06:52:19 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:52:19 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:52:19 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9cf889-503c-49b4-8f7a-8846d4ec4cc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:19 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9688ae3-a732-4d48-a8f6-cddd5d5a9f40]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 (non-flash)
Apr 12 06:52:20 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 (non-flash)
Apr 12 06:52:20 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995421bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2'): ({'sdd'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Removing single pathed devices sdd {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[830cf4f2-89b1-4c2f-b9bc-c47909adab73]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab541634-0863-4776-8d8f-c1b44047b32c]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Flushing IO for device /dev/sdd {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3670af4d-ae16-47ad-95db-a5b62e5e9bcc]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[753cb791-a7a2-4a7b-9044-5d273c19c808]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed7f72f-28a5-45c4-9961-1712f9074200]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa71449-e1f9-49f9-9383-626328180869]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2, portal: 172.16.0.220,3260]
Apr 12 06:52:20 user nova-compute[71711]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2, portal: 172.16.0.220,3260] successful.
Apr 12 06:52:20 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbbb1a6-c094-4a11-beef-499b756020f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0300988-0290-454e-9332-c923e08effa1]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] <== disconnect_volume: return (299ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:52:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.compute.manager [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:52:22 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Creating image(s)
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Ensure instance console log exists: /opt/stack/data/nova/instances/e13297b8-5f8a-46e8-8793-a092b5b4fc9e/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Start _get_guest_xml network_info=[{"id": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "address": "fa:16:3e:4f:38:76", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d92724c-b2", "ovs_interfaceid": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvwNblrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e13297b8-5f8a-46e8-8793-a092b5b4fc9e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'serial': 'c94a19e9-963c-4e8e-a613-6fc05da1dce3'}, 'attachment_id': '25944eb2-2045-43af-9383-e763b299a0ea', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:52:22 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:52:22 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvwNblrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:52:22 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:52:22 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:52:22 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2f0e8b-6691-4b84-b104-a0d6e8e70b3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:52:22 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1176800e-dbf2-4e82-b971-a3620f7fe031]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3] added
Apr 12 06:52:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c59779-8deb-4406-a121-2fc936f55238]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab10d296-4989-4279-85e9-d7af018b69ac]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvwNblrW {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG nova.objects.instance [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'flavor' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvwNblrW" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a261094-be7a-46cc-93fa-aba5b7e28ec4]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HvwNblrW'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0421e5-596d-42d4-bf14-713f85cc447a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b344c34e-0733-48b3-9e37-ef77f000f7a3 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "02209375-f25a-4d51-9828-3422144c2ed8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.292s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfcd162-1e2d-4548-86b0-d28984bcc906]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:52:22 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:52:22 user nova-compute[71711]:  {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:52:22 user nova-compute[71711]: WARNING os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 06:52:22 user nova-compute[71711]: 
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6732b24f-7494-42e9-9a41-6fb20aa3d92e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3, portal: 172.16.0.220,3260]
Apr 12 06:52:22 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3, portal: 172.16.0.220,3260] successful.
Apr 12 06:52:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee65c80-487f-490c-b588-a5a4d45583c6]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd1dde6-e75c-4e0a-9e47-b1021f2d15f4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:52:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:52:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0ca01c-cdb4-43e0-8980-cad6284564da]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:52:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvwNblrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26266353066313039', 'path': '/dev/sdb'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266353066313039', 'path': '/dev/sdb'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1017592903',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1017592903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1017592903',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-mqcpf9xt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:52:17Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=e13297b8-5f8a-46e8-8793-a092b5b4fc9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "address": "fa:16:3e:4f:38:76", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d92724c-b2", "ovs_interfaceid": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "address": "fa:16:3e:4f:38:76", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d92724c-b2", "ovs_interfaceid": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:38:76,bridge_name='br-int',has_traffic_filtering=True,id=3d92724c-b271-4ead-a1b5-821d82d0ec85,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d92724c-b2') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG nova.objects.instance [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lazy-loading 'pci_devices' on Instance uuid e13297b8-5f8a-46e8-8793-a092b5b4fc9e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:52:23 user nova-compute[71711]:   <uuid>e13297b8-5f8a-46e8-8793-a092b5b4fc9e</uuid>
Apr 12 06:52:23 user nova-compute[71711]:   <name>instance-00000029</name>
Apr 12 06:52:23 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:52:23 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:52:23 user nova-compute[71711]:   <metadata>
Apr 12 06:52:23 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:52:23 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:52:23 user nova-compute[71711]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1017592903</nova:name>
Apr 12 06:52:23 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:52:22</nova:creationTime>
Apr 12 06:52:23 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:52:23 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:52:23 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:52:23 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:52:23 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:52:23 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:52:23 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:52:23 user nova-compute[71711]:       <nova:owner>
Apr 12 06:52:23 user nova-compute[71711]:         <nova:user uuid="1fec39f776464d339142eeed1ba95a6d">tempest-TestVolumeBootPattern-294210775-project-member</nova:user>
Apr 12 06:52:23 user nova-compute[71711]:         <nova:project uuid="13d1513e8b784c758412ddfc2692bb22">tempest-TestVolumeBootPattern-294210775</nova:project>
Apr 12 06:52:23 user nova-compute[71711]:       </nova:owner>
Apr 12 06:52:23 user nova-compute[71711]:       <nova:ports>
Apr 12 06:52:23 user nova-compute[71711]:         <nova:port uuid="3d92724c-b271-4ead-a1b5-821d82d0ec85">
Apr 12 06:52:23 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 06:52:23 user nova-compute[71711]:         </nova:port>
Apr 12 06:52:23 user nova-compute[71711]:       </nova:ports>
Apr 12 06:52:23 user nova-compute[71711]:     </nova:instance>
Apr 12 06:52:23 user nova-compute[71711]:   </metadata>
Apr 12 06:52:23 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:52:23 user nova-compute[71711]:     <system>
Apr 12 06:52:23 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:52:23 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:52:23 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:52:23 user nova-compute[71711]:       <entry name="serial">e13297b8-5f8a-46e8-8793-a092b5b4fc9e</entry>
Apr 12 06:52:23 user nova-compute[71711]:       <entry name="uuid">e13297b8-5f8a-46e8-8793-a092b5b4fc9e</entry>
Apr 12 06:52:23 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:52:23 user nova-compute[71711]:     </system>
Apr 12 06:52:23 user nova-compute[71711]:   </sysinfo>
Apr 12 06:52:23 user nova-compute[71711]:   <os>
Apr 12 06:52:23 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:52:23 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:52:23 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:52:23 user nova-compute[71711]:   </os>
Apr 12 06:52:23 user nova-compute[71711]:   <features>
Apr 12 06:52:23 user nova-compute[71711]:     <acpi/>
Apr 12 06:52:23 user nova-compute[71711]:     <apic/>
Apr 12 06:52:23 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:52:23 user nova-compute[71711]:   </features>
Apr 12 06:52:23 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:52:23 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:52:23 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:52:23 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:52:23 user nova-compute[71711]:   </clock>
Apr 12 06:52:23 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:52:23 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:52:23 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:52:23 user nova-compute[71711]:   </cpu>
Apr 12 06:52:23 user nova-compute[71711]:   <devices>
Apr 12 06:52:23 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:52:23 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:52:23 user nova-compute[71711]:       <source dev="/dev/sdb"/>
Apr 12 06:52:23 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:52:23 user nova-compute[71711]:       <serial>c94a19e9-963c-4e8e-a613-6fc05da1dce3</serial>
Apr 12 06:52:23 user nova-compute[71711]:     </disk>
Apr 12 06:52:23 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:52:23 user nova-compute[71711]:       <mac address="fa:16:3e:4f:38:76"/>
Apr 12 06:52:23 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:52:23 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:52:23 user nova-compute[71711]:       <target dev="tap3d92724c-b2"/>
Apr 12 06:52:23 user nova-compute[71711]:     </interface>
Apr 12 06:52:23 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:52:23 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/e13297b8-5f8a-46e8-8793-a092b5b4fc9e/console.log" append="off"/>
Apr 12 06:52:23 user nova-compute[71711]:     </serial>
Apr 12 06:52:23 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:52:23 user nova-compute[71711]:     <video>
Apr 12 06:52:23 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:52:23 user nova-compute[71711]:     </video>
Apr 12 06:52:23 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:52:23 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:52:23 user nova-compute[71711]:     </rng>
Apr 12 06:52:23 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:52:23 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:52:23 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:52:23 user nova-compute[71711]:     </memballoon>
Apr 12 06:52:23 user nova-compute[71711]:   </devices>
Apr 12 06:52:23 user nova-compute[71711]: </domain>
Apr 12 06:52:23 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1017592903',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1017592903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1017592903',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-mqcpf9xt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:52:17Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=e13297b8-5f8a-46e8-8793-a092b5b4fc9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "address": "fa:16:3e:4f:38:76", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d92724c-b2", "ovs_interfaceid": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "address": "fa:16:3e:4f:38:76", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d92724c-b2", "ovs_interfaceid": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:38:76,bridge_name='br-int',has_traffic_filtering=True,id=3d92724c-b271-4ead-a1b5-821d82d0ec85,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d92724c-b2') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG os_vif [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:38:76,bridge_name='br-int',has_traffic_filtering=True,id=3d92724c-b271-4ead-a1b5-821d82d0ec85,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d92724c-b2') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d92724c-b2, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d92724c-b2, col_values=(('external_ids', {'iface-id': '3d92724c-b271-4ead-a1b5-821d82d0ec85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:38:76', 'vm-uuid': 'e13297b8-5f8a-46e8-8793-a092b5b4fc9e'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:23 user nova-compute[71711]: INFO os_vif [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:38:76,bridge_name='br-int',has_traffic_filtering=True,id=3d92724c-b271-4ead-a1b5-821d82d0ec85,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d92724c-b2')
Apr 12 06:52:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:52:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] No VIF found with MAC fa:16:3e:4f:38:76, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:52:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-8c6e1242-e72d-4146-aa32-a564a97c03f5 req-7dbd6d54-7228-4b90-8bd1-bf4964fe0309 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Received event network-vif-plugged-3d92724c-b271-4ead-a1b5-821d82d0ec85 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:52:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8c6e1242-e72d-4146-aa32-a564a97c03f5 req-7dbd6d54-7228-4b90-8bd1-bf4964fe0309 service nova] Acquiring lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:52:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8c6e1242-e72d-4146-aa32-a564a97c03f5 req-7dbd6d54-7228-4b90-8bd1-bf4964fe0309 service nova] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:52:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8c6e1242-e72d-4146-aa32-a564a97c03f5 req-7dbd6d54-7228-4b90-8bd1-bf4964fe0309 service nova] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:52:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-8c6e1242-e72d-4146-aa32-a564a97c03f5 req-7dbd6d54-7228-4b90-8bd1-bf4964fe0309 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] No waiting events found dispatching network-vif-plugged-3d92724c-b271-4ead-a1b5-821d82d0ec85 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:52:25 user nova-compute[71711]: WARNING nova.compute.manager [req-8c6e1242-e72d-4146-aa32-a564a97c03f5 req-7dbd6d54-7228-4b90-8bd1-bf4964fe0309 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Received unexpected event network-vif-plugged-3d92724c-b271-4ead-a1b5-821d82d0ec85 for instance with vm_state building and task_state spawning.
Apr 12 06:52:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282347.4529045, e13297b8-5f8a-46e8-8793-a092b5b4fc9e => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:52:27 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] VM Resumed (Lifecycle Event)
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:52:27 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Instance spawned successfully.
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:52:27 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282347.4538825, e13297b8-5f8a-46e8-8793-a092b5b4fc9e => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:52:27 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] VM Started (Lifecycle Event)
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:52:27 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:52:27 user nova-compute[71711]: INFO nova.compute.manager [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Took 5.20 seconds to spawn the instance on the hypervisor.
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.compute.manager [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-16423bfe-6e5c-4f3f-bd10-beaf1a92ee13 req-61df8f28-3bdd-430b-9c57-ab882f538ca2 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Received event network-vif-plugged-3d92724c-b271-4ead-a1b5-821d82d0ec85 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-16423bfe-6e5c-4f3f-bd10-beaf1a92ee13 req-61df8f28-3bdd-430b-9c57-ab882f538ca2 service nova] Acquiring lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-16423bfe-6e5c-4f3f-bd10-beaf1a92ee13 req-61df8f28-3bdd-430b-9c57-ab882f538ca2 service nova] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-16423bfe-6e5c-4f3f-bd10-beaf1a92ee13 req-61df8f28-3bdd-430b-9c57-ab882f538ca2 service nova] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:52:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-16423bfe-6e5c-4f3f-bd10-beaf1a92ee13 req-61df8f28-3bdd-430b-9c57-ab882f538ca2 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] No waiting events found dispatching network-vif-plugged-3d92724c-b271-4ead-a1b5-821d82d0ec85 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:52:27 user nova-compute[71711]: WARNING nova.compute.manager [req-16423bfe-6e5c-4f3f-bd10-beaf1a92ee13 req-61df8f28-3bdd-430b-9c57-ab882f538ca2 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Received unexpected event network-vif-plugged-3d92724c-b271-4ead-a1b5-821d82d0ec85 for instance with vm_state building and task_state spawning.
Apr 12 06:52:27 user nova-compute[71711]: INFO nova.compute.manager [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Took 11.42 seconds to build instance.
Apr 12 06:52:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-29ba84ac-7f59-43ae-85ea-71799fe37d5c tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.508s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:52:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:52:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:52:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:52:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:52:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:52:31 user nova-compute[71711]: INFO nova.compute.manager [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Terminating instance
Apr 12 06:52:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:52:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG nova.compute.manager [req-111fc19c-6eae-46a8-9e17-e3dc26cff505 req-fa295027-f346-4632-bd02-cadd5b04e355 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-vif-unplugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-111fc19c-6eae-46a8-9e17-e3dc26cff505 req-fa295027-f346-4632-bd02-cadd5b04e355 service nova] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-111fc19c-6eae-46a8-9e17-e3dc26cff505 req-fa295027-f346-4632-bd02-cadd5b04e355 service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-111fc19c-6eae-46a8-9e17-e3dc26cff505 req-fa295027-f346-4632-bd02-cadd5b04e355 service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG nova.compute.manager [req-111fc19c-6eae-46a8-9e17-e3dc26cff505 req-fa295027-f346-4632-bd02-cadd5b04e355 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] No waiting events found dispatching network-vif-unplugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG nova.compute.manager [req-111fc19c-6eae-46a8-9e17-e3dc26cff505 req-fa295027-f346-4632-bd02-cadd5b04e355 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-vif-unplugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:52:32 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 1d45a146-795c-455e-be0f-93227183720a] Instance destroyed successfully.
Apr 12 06:52:32 user nova-compute[71711]: DEBUG nova.objects.instance [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'resources' on Instance uuid 1d45a146-795c-455e-be0f-93227183720a {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1404205967',display_name='tempest-TestMinimumBasicScenario-server-1404205967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1404205967',id=39,image_ref='bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYd1vxt6IOrCuDq8XQobzqeuQGl6sxwoZi2oqGAmYsaM1r02sLjpGCkffLXipByEs9yCp4tNOTiJcnVwggG5nCwVGjhlV6IvXoxSNHVUegrF0R0F2o1Aem8cawIyFgPFQ==',key_name='tempest-TestMinimumBasicScenario-1175210425',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:47:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1aacffb9fbd4398b98db1f1945138dc',ramdisk_id='',reservation_id='r-n0fts2f6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf27dd5e-60f5-4726-a7f6-ac0936e3e1e9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1474504992',owner_user_name='tempest-TestMinimumBasicScenario-1474504992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:49:54Z,user_data=None,user_id='2a188723ace3460792ed32d13bfe0d93',uuid=1d45a146-795c-455e-be0f-93227183720a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converting VIF {"id": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "address": "fa:16:3e:b4:ca:39", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37cc833c-e2", "ovs_interfaceid": "37cc833c-e20d-4d31-9ecf-389dc5e2f2d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG os_vif [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37cc833c-e2, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:52:32 user nova-compute[71711]: INFO os_vif [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:ca:39,bridge_name='br-int',has_traffic_filtering=True,id=37cc833c-e20d-4d31-9ecf-389dc5e2f2d6,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37cc833c-e2')
Apr 12 06:52:32 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Deleting instance files /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a_del
Apr 12 06:52:32 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Deletion of /opt/stack/data/nova/instances/1d45a146-795c-455e-be0f-93227183720a_del complete
Apr 12 06:52:32 user nova-compute[71711]: INFO nova.compute.manager [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 1d45a146-795c-455e-be0f-93227183720a] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 12 06:52:32 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 1d45a146-795c-455e-be0f-93227183720a] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:52:32 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 1d45a146-795c-455e-be0f-93227183720a] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:52:33 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 1d45a146-795c-455e-be0f-93227183720a] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:52:33 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 1d45a146-795c-455e-be0f-93227183720a] Took 0.41 seconds to deallocate network for instance.
Apr 12 06:52:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-806af780-f42a-4798-a06c-83477de4cab5 req-2a869631-a024-4248-b891-f759c88a7413 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-vif-deleted-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:52:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:52:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:52:33 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:52:33 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:52:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:52:33 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Deleted allocations for instance 1d45a146-795c-455e-be0f-93227183720a
Apr 12 06:52:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-b30698fc-4201-4e56-a378-5d735c4007bb tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "1d45a146-795c-455e-be0f-93227183720a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.612s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:52:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-c621d86e-b407-4698-90ab-397be4c05521 req-d6605317-1d5c-43f2-b7f4-4d82803e6de2 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received event network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:52:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c621d86e-b407-4698-90ab-397be4c05521 req-d6605317-1d5c-43f2-b7f4-4d82803e6de2 service nova] Acquiring lock "1d45a146-795c-455e-be0f-93227183720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:52:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c621d86e-b407-4698-90ab-397be4c05521 req-d6605317-1d5c-43f2-b7f4-4d82803e6de2 service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:52:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c621d86e-b407-4698-90ab-397be4c05521 req-d6605317-1d5c-43f2-b7f4-4d82803e6de2 service nova] Lock "1d45a146-795c-455e-be0f-93227183720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:52:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-c621d86e-b407-4698-90ab-397be4c05521 req-d6605317-1d5c-43f2-b7f4-4d82803e6de2 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] No waiting events found dispatching network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:52:34 user nova-compute[71711]: WARNING nova.compute.manager [req-c621d86e-b407-4698-90ab-397be4c05521 req-d6605317-1d5c-43f2-b7f4-4d82803e6de2 service nova] [instance: 1d45a146-795c-455e-be0f-93227183720a] Received unexpected event network-vif-plugged-37cc833c-e20d-4d31-9ecf-389dc5e2f2d6 for instance with vm_state deleted and task_state None.
Apr 12 06:52:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:47 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681282352.583725, 1d45a146-795c-455e-be0f-93227183720a => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:52:47 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 1d45a146-795c-455e-be0f-93227183720a] VM Stopped (Lifecycle Event)
Apr 12 06:52:47 user nova-compute[71711]: DEBUG nova.compute.manager [None req-85180ce2-c568-440a-b0aa-45bcc4f00c23 None None] [instance: 1d45a146-795c-455e-be0f-93227183720a] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:52:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:52:56 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:52:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:53:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:53:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:53:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:53:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "02209375-f25a-4d51-9828-3422144c2ed8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:09 user nova-compute[71711]: INFO nova.compute.manager [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Terminating instance
Apr 12 06:53:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG nova.compute.manager [req-065506d8-7dcd-4f58-97c5-9b46ae474703 req-18ac6666-d1ed-40a7-9ffa-147e7dd5f5f9 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-unplugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-065506d8-7dcd-4f58-97c5-9b46ae474703 req-18ac6666-d1ed-40a7-9ffa-147e7dd5f5f9 service nova] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-065506d8-7dcd-4f58-97c5-9b46ae474703 req-18ac6666-d1ed-40a7-9ffa-147e7dd5f5f9 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-065506d8-7dcd-4f58-97c5-9b46ae474703 req-18ac6666-d1ed-40a7-9ffa-147e7dd5f5f9 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG nova.compute.manager [req-065506d8-7dcd-4f58-97c5-9b46ae474703 req-18ac6666-d1ed-40a7-9ffa-147e7dd5f5f9 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] No waiting events found dispatching network-vif-unplugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:53:09 user nova-compute[71711]: DEBUG nova.compute.manager [req-065506d8-7dcd-4f58-97c5-9b46ae474703 req-18ac6666-d1ed-40a7-9ffa-147e7dd5f5f9 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-unplugged-e6c75186-26c0-414f-9dfe-13cb03283057 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:10 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Instance destroyed successfully.
Apr 12 06:53:10 user nova-compute[71711]: DEBUG nova.objects.instance [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'resources' on Instance uuid 02209375-f25a-4d51-9828-3422144c2ed8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:46:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2020171009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2020171009',id=38,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZegZIYK1I87WzI/GopP0gFDiVIk2m3tD+Xr8CMKYFLScduowkDoSCdMQjYZBkxgp/FVmCcjJUpm9/3fq/7gj6jh4/k43FpV6VBh16G/3bTDxKZLcvBw9dpNKFRqAyABQ==',key_name='tempest-keypair-914952928',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76a8460ce5c24d1db20e80a1659133f7',ramdisk_id='',reservation_id='r-5iy62es8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1986658224',owner_user_name='tempest-AttachVolumeShelveTestJSON-1986658224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fbb8c37e5a74a0b83011c2a21033204',uuid=02209375-f25a-4d51-9828-3422144c2ed8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converting VIF {"id": "e6c75186-26c0-414f-9dfe-13cb03283057", "address": "fa:16:3e:03:ee:ad", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c75186-26", "ovs_interfaceid": "e6c75186-26c0-414f-9dfe-13cb03283057", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG os_vif [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6c75186-26, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:53:10 user nova-compute[71711]: INFO os_vif [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:ee:ad,bridge_name='br-int',has_traffic_filtering=True,id=e6c75186-26c0-414f-9dfe-13cb03283057,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c75186-26')
Apr 12 06:53:10 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Deleting instance files /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8_del
Apr 12 06:53:10 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Deletion of /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8_del complete
Apr 12 06:53:10 user nova-compute[71711]: INFO nova.compute.manager [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 06:53:10 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:53:10 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000026, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/02209375-f25a-4d51-9828-3422144c2ed8/disk
Apr 12 06:53:10 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:53:10 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:53:10 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:53:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8729MB free_disk=26.145469665527344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 02209375-f25a-4d51-9828-3422144c2ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing inventories for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating ProviderTree inventory for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating inventory in ProviderTree for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing aggregate associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, aggregates: None {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing trait associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, traits: HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:53:11 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Took 1.22 seconds to deallocate network for instance.
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] No waiting events found dispatching network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:53:11 user nova-compute[71711]: WARNING nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received unexpected event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 for instance with vm_state deleted and task_state None.
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] No waiting events found dispatching network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:53:11 user nova-compute[71711]: WARNING nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received unexpected event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 for instance with vm_state deleted and task_state None.
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] No waiting events found dispatching network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:53:11 user nova-compute[71711]: WARNING nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received unexpected event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 for instance with vm_state deleted and task_state None.
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-unplugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] No waiting events found dispatching network-vif-unplugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:53:11 user nova-compute[71711]: WARNING nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received unexpected event network-vif-unplugged-e6c75186-26c0-414f-9dfe-13cb03283057 for instance with vm_state deleted and task_state None.
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Acquiring lock "02209375-f25a-4d51-9828-3422144c2ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] Lock "02209375-f25a-4d51-9828-3422144c2ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] No waiting events found dispatching network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:53:11 user nova-compute[71711]: WARNING nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received unexpected event network-vif-plugged-e6c75186-26c0-414f-9dfe-13cb03283057 for instance with vm_state deleted and task_state None.
Apr 12 06:53:11 user nova-compute[71711]: DEBUG nova.compute.manager [req-76230798-8513-4f97-b417-d80e200a9cee req-ef954511-2443-4ce3-a3c2-e6639d2679c0 service nova] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Received event network-vif-deleted-e6c75186-26c0-414f-9dfe-13cb03283057 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:53:11 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Deleted allocations for instance 02209375-f25a-4d51-9828-3422144c2ed8
Apr 12 06:53:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-8becf604-949a-440f-aa92-93d1df4d1db0 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "02209375-f25a-4d51-9828-3422144c2ed8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.425s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:53:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:53:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:53:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 06:53:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:21 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:53:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71711) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 06:53:23 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:53:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 06:53:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] There are 0 instances to clean {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 06:53:25 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681282390.3736205, 02209375-f25a-4d51-9828-3422144c2ed8 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:53:25 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] VM Stopped (Lifecycle Event)
Apr 12 06:53:25 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ce942be1-ab44-4cca-999b-95ab43cd3416 None None] [instance: 02209375-f25a-4d51-9828-3422144c2ed8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:53:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:53:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:53:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:53:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:53:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:25 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:53:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:25 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:53:25 user nova-compute[71711]: INFO nova.compute.claims [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Claim successful on node user
Apr 12 06:53:26 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:53:26 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:53:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:53:26 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Creating image(s)
Apr 12 06:53:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "/opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "/opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "8f190d50d399c7d38b0903c1053bb6315a232e79" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "8f190d50d399c7d38b0903c1053bb6315a232e79" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79.part --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG nova.policy [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a188723ace3460792ed32d13bfe0d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1aacffb9fbd4398b98db1f1945138dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:53:26 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79.part --force-share --output=json" returned: 0 in 0.151s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG nova.virt.images [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] f80d148a-a25f-4656-aa33-568629afd9ae was qcow2, converting to raw {{(pid=71711) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79.part /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79.converted {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79.part /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79.converted" returned: 0 in 0.346s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79.converted --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "8f190d50d399c7d38b0903c1053bb6315a232e79" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.140s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79 --force-share --output=json" returned: 0 in 0.157s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "8f190d50d399c7d38b0903c1053bb6315a232e79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "8f190d50d399c7d38b0903c1053bb6315a232e79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Successfully created port: b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79 --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79,backing_fmt=raw /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79,backing_fmt=raw /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk 1073741824" returned: 0 in 0.048s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "8f190d50d399c7d38b0903c1053bb6315a232e79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:27 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79 --force-share --output=json" returned: 0 in 0.131s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Cannot resize image /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.objects.instance [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'migration_context' on Instance uuid 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Ensure instance console log exists: /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Successfully updated port: b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquired lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-changed-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.compute.manager [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Refreshing instance network info cache due to event network-changed-b99eaecc-c588-46cb-84bf-10c63272eebf. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] Acquiring lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.network.neutron [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updating instance_info_cache with network_info: [{"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Releasing lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Instance network_info: |[{"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] Acquired lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.network.neutron [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Refreshing network info cache for port b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Start _get_guest_xml network_info=[{"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:53:23Z,direct_url=<?>,disk_format='qcow2',id=f80d148a-a25f-4656-aa33-568629afd9ae,min_disk=0,min_ram=0,name='tempest-scenario-img--118327325',owner='d1aacffb9fbd4398b98db1f1945138dc',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:53:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': 'f80d148a-a25f-4656-aa33-568629afd9ae'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:53:28 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:53:28 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:53:23Z,direct_url=<?>,disk_format='qcow2',id=f80d148a-a25f-4656-aa33-568629afd9ae,min_disk=0,min_ram=0,name='tempest-scenario-img--118327325',owner='d1aacffb9fbd4398b98db1f1945138dc',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:53:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:53:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1315008543',display_name='tempest-TestMinimumBasicScenario-server-1315008543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1315008543',id=42,image_ref='f80d148a-a25f-4656-aa33-568629afd9ae',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8omkAJ5QHXkbKVRiHFVG85cy80mBAbjxhQvXag1lrvEbH1vHi0AGYDPUpjAceyOw/UFX83aigQSWD29PXNlZ1i7g1u31wJY0pxuKqHAxdqoT9OXDVoKHd5rVyKkUvLww==',key_name='tempest-TestMinimumBasicScenario-709112217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1aacffb9fbd4398b98db1f1945138dc',ramdisk_id='',reservation_id='r-3aq4zp3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f80d148a-a25f-4656-aa33-568629afd9ae',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1474504992',owner_user_name='tempest-TestMinimumBasicScenario-1474504992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:53:26Z,user_data=None,user_id='2a188723ace3460792ed32d13bfe0d93',uuid=6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converting VIF {"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:b6:18,bridge_name='br-int',has_traffic_filtering=True,id=b99eaecc-c588-46cb-84bf-10c63272eebf,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99eaecc-c5') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.objects.instance [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:53:28 user nova-compute[71711]:   <uuid>6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4</uuid>
Apr 12 06:53:28 user nova-compute[71711]:   <name>instance-0000002a</name>
Apr 12 06:53:28 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:53:28 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:53:28 user nova-compute[71711]:   <metadata>
Apr 12 06:53:28 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:53:28 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:53:28 user nova-compute[71711]:       <nova:name>tempest-TestMinimumBasicScenario-server-1315008543</nova:name>
Apr 12 06:53:28 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:53:28</nova:creationTime>
Apr 12 06:53:28 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:53:28 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:53:28 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:53:28 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:53:28 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:53:28 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:53:28 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:53:28 user nova-compute[71711]:       <nova:owner>
Apr 12 06:53:28 user nova-compute[71711]:         <nova:user uuid="2a188723ace3460792ed32d13bfe0d93">tempest-TestMinimumBasicScenario-1474504992-project-member</nova:user>
Apr 12 06:53:28 user nova-compute[71711]:         <nova:project uuid="d1aacffb9fbd4398b98db1f1945138dc">tempest-TestMinimumBasicScenario-1474504992</nova:project>
Apr 12 06:53:28 user nova-compute[71711]:       </nova:owner>
Apr 12 06:53:28 user nova-compute[71711]:       <nova:root type="image" uuid="f80d148a-a25f-4656-aa33-568629afd9ae"/>
Apr 12 06:53:28 user nova-compute[71711]:       <nova:ports>
Apr 12 06:53:28 user nova-compute[71711]:         <nova:port uuid="b99eaecc-c588-46cb-84bf-10c63272eebf">
Apr 12 06:53:28 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 06:53:28 user nova-compute[71711]:         </nova:port>
Apr 12 06:53:28 user nova-compute[71711]:       </nova:ports>
Apr 12 06:53:28 user nova-compute[71711]:     </nova:instance>
Apr 12 06:53:28 user nova-compute[71711]:   </metadata>
Apr 12 06:53:28 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:53:28 user nova-compute[71711]:     <system>
Apr 12 06:53:28 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:53:28 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:53:28 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:53:28 user nova-compute[71711]:       <entry name="serial">6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4</entry>
Apr 12 06:53:28 user nova-compute[71711]:       <entry name="uuid">6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4</entry>
Apr 12 06:53:28 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:53:28 user nova-compute[71711]:     </system>
Apr 12 06:53:28 user nova-compute[71711]:   </sysinfo>
Apr 12 06:53:28 user nova-compute[71711]:   <os>
Apr 12 06:53:28 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:53:28 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:53:28 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:53:28 user nova-compute[71711]:   </os>
Apr 12 06:53:28 user nova-compute[71711]:   <features>
Apr 12 06:53:28 user nova-compute[71711]:     <acpi/>
Apr 12 06:53:28 user nova-compute[71711]:     <apic/>
Apr 12 06:53:28 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:53:28 user nova-compute[71711]:   </features>
Apr 12 06:53:28 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:53:28 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:53:28 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:53:28 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:53:28 user nova-compute[71711]:   </clock>
Apr 12 06:53:28 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:53:28 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:53:28 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:53:28 user nova-compute[71711]:   </cpu>
Apr 12 06:53:28 user nova-compute[71711]:   <devices>
Apr 12 06:53:28 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:53:28 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:53:28 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk"/>
Apr 12 06:53:28 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:53:28 user nova-compute[71711]:     </disk>
Apr 12 06:53:28 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:53:28 user nova-compute[71711]:       <mac address="fa:16:3e:29:b6:18"/>
Apr 12 06:53:28 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:53:28 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:53:28 user nova-compute[71711]:       <target dev="tapb99eaecc-c5"/>
Apr 12 06:53:28 user nova-compute[71711]:     </interface>
Apr 12 06:53:28 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:53:28 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/console.log" append="off"/>
Apr 12 06:53:28 user nova-compute[71711]:     </serial>
Apr 12 06:53:28 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:53:28 user nova-compute[71711]:     <video>
Apr 12 06:53:28 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:53:28 user nova-compute[71711]:     </video>
Apr 12 06:53:28 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:53:28 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:53:28 user nova-compute[71711]:     </rng>
Apr 12 06:53:28 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:53:28 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:53:28 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:53:28 user nova-compute[71711]:     </memballoon>
Apr 12 06:53:28 user nova-compute[71711]:   </devices>
Apr 12 06:53:28 user nova-compute[71711]: </domain>
Apr 12 06:53:28 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:53:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1315008543',display_name='tempest-TestMinimumBasicScenario-server-1315008543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1315008543',id=42,image_ref='f80d148a-a25f-4656-aa33-568629afd9ae',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8omkAJ5QHXkbKVRiHFVG85cy80mBAbjxhQvXag1lrvEbH1vHi0AGYDPUpjAceyOw/UFX83aigQSWD29PXNlZ1i7g1u31wJY0pxuKqHAxdqoT9OXDVoKHd5rVyKkUvLww==',key_name='tempest-TestMinimumBasicScenario-709112217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1aacffb9fbd4398b98db1f1945138dc',ramdisk_id='',reservation_id='r-3aq4zp3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f80d148a-a25f-4656-aa33-568629afd9ae',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1474504992',owner_user_name='tempest-TestMinimumBasicScenario-1474504992-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:53:26Z,user_data=None,user_id='2a188723ace3460792ed32d13bfe0d93',uuid=6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converting VIF {"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:b6:18,bridge_name='br-int',has_traffic_filtering=True,id=b99eaecc-c588-46cb-84bf-10c63272eebf,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99eaecc-c5') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG os_vif [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b6:18,bridge_name='br-int',has_traffic_filtering=True,id=b99eaecc-c588-46cb-84bf-10c63272eebf,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99eaecc-c5') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb99eaecc-c5, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb99eaecc-c5, col_values=(('external_ids', {'iface-id': 'b99eaecc-c588-46cb-84bf-10c63272eebf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:b6:18', 'vm-uuid': '6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:28 user nova-compute[71711]: INFO os_vif [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b6:18,bridge_name='br-int',has_traffic_filtering=True,id=b99eaecc-c588-46cb-84bf-10c63272eebf,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99eaecc-c5')
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:53:28 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] No VIF found with MAC fa:16:3e:29:b6:18, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:53:29 user nova-compute[71711]: DEBUG nova.network.neutron [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updated VIF entry in instance network info cache for port b99eaecc-c588-46cb-84bf-10c63272eebf. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:53:29 user nova-compute[71711]: DEBUG nova.network.neutron [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updating instance_info_cache with network_info: [{"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:53:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-98d0dc23-1a23-4697-a5f8-391340c0a898 req-497acf20-aa21-4846-87a7-0fbbfa21f885 service nova] Releasing lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:53:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:30 user nova-compute[71711]: DEBUG nova.compute.manager [req-1ddfa98f-66e5-4ae3-b313-50a6ee2dd3b9 req-7fb34302-6d50-4289-a377-f0b2f2c0390d service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:53:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1ddfa98f-66e5-4ae3-b313-50a6ee2dd3b9 req-7fb34302-6d50-4289-a377-f0b2f2c0390d service nova] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1ddfa98f-66e5-4ae3-b313-50a6ee2dd3b9 req-7fb34302-6d50-4289-a377-f0b2f2c0390d service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-1ddfa98f-66e5-4ae3-b313-50a6ee2dd3b9 req-7fb34302-6d50-4289-a377-f0b2f2c0390d service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:30 user nova-compute[71711]: DEBUG nova.compute.manager [req-1ddfa98f-66e5-4ae3-b313-50a6ee2dd3b9 req-7fb34302-6d50-4289-a377-f0b2f2c0390d service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] No waiting events found dispatching network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:53:30 user nova-compute[71711]: WARNING nova.compute.manager [req-1ddfa98f-66e5-4ae3-b313-50a6ee2dd3b9 req-7fb34302-6d50-4289-a377-f0b2f2c0390d service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received unexpected event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf for instance with vm_state building and task_state spawning.
Apr 12 06:53:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282412.4122374, 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:53:32 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] VM Resumed (Lifecycle Event)
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:53:32 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Instance spawned successfully.
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:53:32 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282412.4135885, 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:53:32 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] VM Started (Lifecycle Event)
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:53:32 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:53:32 user nova-compute[71711]: INFO nova.compute.manager [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Took 6.16 seconds to spawn the instance on the hypervisor.
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.compute.manager [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.compute.manager [req-cc509869-ea9e-4dd7-8420-f0e7a110f10a req-f35f58ea-1e2a-4840-944a-f25c40e33ff2 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cc509869-ea9e-4dd7-8420-f0e7a110f10a req-f35f58ea-1e2a-4840-944a-f25c40e33ff2 service nova] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cc509869-ea9e-4dd7-8420-f0e7a110f10a req-f35f58ea-1e2a-4840-944a-f25c40e33ff2 service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-cc509869-ea9e-4dd7-8420-f0e7a110f10a req-f35f58ea-1e2a-4840-944a-f25c40e33ff2 service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:32 user nova-compute[71711]: DEBUG nova.compute.manager [req-cc509869-ea9e-4dd7-8420-f0e7a110f10a req-f35f58ea-1e2a-4840-944a-f25c40e33ff2 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] No waiting events found dispatching network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:53:32 user nova-compute[71711]: WARNING nova.compute.manager [req-cc509869-ea9e-4dd7-8420-f0e7a110f10a req-f35f58ea-1e2a-4840-944a-f25c40e33ff2 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received unexpected event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf for instance with vm_state building and task_state spawning.
Apr 12 06:53:32 user nova-compute[71711]: INFO nova.compute.manager [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Took 6.73 seconds to build instance.
Apr 12 06:53:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-5a0c6a2f-5e58-4c4e-b99c-797dc466704e tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.829s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:53:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:53:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:53:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:53:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:53:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:57 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:53:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:53:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "3666a910-9199-4582-8eb7-7b3b6263a535" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:03 user nova-compute[71711]: DEBUG nova.compute.manager [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:54:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:03 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:54:03 user nova-compute[71711]: INFO nova.compute.claims [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Claim successful on node user
Apr 12 06:54:03 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:54:03 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:54:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:03 user nova-compute[71711]: DEBUG nova.compute.manager [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:54:03 user nova-compute[71711]: DEBUG nova.compute.manager [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:54:03 user nova-compute[71711]: DEBUG nova.network.neutron [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:54:03 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:54:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:03 user nova-compute[71711]: DEBUG nova.compute.manager [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG nova.policy [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fbb8c37e5a74a0b83011c2a21033204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a8460ce5c24d1db20e80a1659133f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG nova.compute.manager [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:54:04 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Creating image(s)
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "/opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "/opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "/opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "22d6fa84953e1739938382b986a4a62193eceb83" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83,backing_fmt=raw /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk 1073741824" returned: 0 in 0.064s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "22d6fa84953e1739938382b986a4a62193eceb83" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.129s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk. size=1073741824 {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG nova.virt.disk.api [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Cannot resize image /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk to a smaller size. {{(pid=71711) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG nova.objects.instance [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'migration_context' on Instance uuid 3666a910-9199-4582-8eb7-7b3b6263a535 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Ensure instance console log exists: /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:04 user nova-compute[71711]: DEBUG nova.network.neutron [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Successfully created port: 195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.network.neutron [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Successfully updated port: 195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquired lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.network.neutron [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.network.neutron [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-changed-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.compute.manager [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Refreshing instance network info cache due to event network-changed-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] Acquiring lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.network.neutron [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updating instance_info_cache with network_info: [{"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Releasing lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.compute.manager [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Instance network_info: |[{"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] Acquired lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.network.neutron [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Refreshing network info cache for port 195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Start _get_guest_xml network_info=[{"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:54:05 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:54:05 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T06:18:01Z,direct_url=<?>,disk_format='qcow2',id=4f2549ed-915f-4494-87f3-9269834fa9da,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='d17c81157dc240a396f20e397d55ef65',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T06:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1061983954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1061983954',id=43,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZatAJqhPRKbsg3G5XFC/JkrKoFRPA+0R2UIBKzFMOJlUFJ6rJIELVTlaoiATccS59Gqp4lgra8q75tm0fDyDA6b//ESxqIoXD4S2MxQGGB56gMpEm5qcZHQfzxVjPWzQ==',key_name='tempest-keypair-1503210292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76a8460ce5c24d1db20e80a1659133f7',ramdisk_id='',reservation_id='r-a0bmlrhx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1986658224',owner_user_name='tempest-AttachVolumeShelveTestJSON-1986658224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fbb8c37e5a74a0b83011c2a21033204',uuid=3666a910-9199-4582-8eb7-7b3b6263a535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converting VIF {"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.objects.instance [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'pci_devices' on Instance uuid 3666a910-9199-4582-8eb7-7b3b6263a535 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:54:05 user nova-compute[71711]:   <uuid>3666a910-9199-4582-8eb7-7b3b6263a535</uuid>
Apr 12 06:54:05 user nova-compute[71711]:   <name>instance-0000002b</name>
Apr 12 06:54:05 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:54:05 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:54:05 user nova-compute[71711]:   <metadata>
Apr 12 06:54:05 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:54:05 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:54:05 user nova-compute[71711]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1061983954</nova:name>
Apr 12 06:54:05 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:54:05</nova:creationTime>
Apr 12 06:54:05 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:54:05 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:54:05 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:54:05 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:54:05 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:54:05 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:54:05 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:54:05 user nova-compute[71711]:       <nova:owner>
Apr 12 06:54:05 user nova-compute[71711]:         <nova:user uuid="4fbb8c37e5a74a0b83011c2a21033204">tempest-AttachVolumeShelveTestJSON-1986658224-project-member</nova:user>
Apr 12 06:54:05 user nova-compute[71711]:         <nova:project uuid="76a8460ce5c24d1db20e80a1659133f7">tempest-AttachVolumeShelveTestJSON-1986658224</nova:project>
Apr 12 06:54:05 user nova-compute[71711]:       </nova:owner>
Apr 12 06:54:05 user nova-compute[71711]:       <nova:root type="image" uuid="4f2549ed-915f-4494-87f3-9269834fa9da"/>
Apr 12 06:54:05 user nova-compute[71711]:       <nova:ports>
Apr 12 06:54:05 user nova-compute[71711]:         <nova:port uuid="195ab8fb-eb21-4623-806e-6f8ff7a6f2ea">
Apr 12 06:54:05 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 06:54:05 user nova-compute[71711]:         </nova:port>
Apr 12 06:54:05 user nova-compute[71711]:       </nova:ports>
Apr 12 06:54:05 user nova-compute[71711]:     </nova:instance>
Apr 12 06:54:05 user nova-compute[71711]:   </metadata>
Apr 12 06:54:05 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:54:05 user nova-compute[71711]:     <system>
Apr 12 06:54:05 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:54:05 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:54:05 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:54:05 user nova-compute[71711]:       <entry name="serial">3666a910-9199-4582-8eb7-7b3b6263a535</entry>
Apr 12 06:54:05 user nova-compute[71711]:       <entry name="uuid">3666a910-9199-4582-8eb7-7b3b6263a535</entry>
Apr 12 06:54:05 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:54:05 user nova-compute[71711]:     </system>
Apr 12 06:54:05 user nova-compute[71711]:   </sysinfo>
Apr 12 06:54:05 user nova-compute[71711]:   <os>
Apr 12 06:54:05 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:54:05 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:54:05 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:54:05 user nova-compute[71711]:   </os>
Apr 12 06:54:05 user nova-compute[71711]:   <features>
Apr 12 06:54:05 user nova-compute[71711]:     <acpi/>
Apr 12 06:54:05 user nova-compute[71711]:     <apic/>
Apr 12 06:54:05 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:54:05 user nova-compute[71711]:   </features>
Apr 12 06:54:05 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:54:05 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:54:05 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:54:05 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:54:05 user nova-compute[71711]:   </clock>
Apr 12 06:54:05 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:54:05 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:54:05 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:54:05 user nova-compute[71711]:   </cpu>
Apr 12 06:54:05 user nova-compute[71711]:   <devices>
Apr 12 06:54:05 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:54:05 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:54:05 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk"/>
Apr 12 06:54:05 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:54:05 user nova-compute[71711]:     </disk>
Apr 12 06:54:05 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:54:05 user nova-compute[71711]:       <mac address="fa:16:3e:87:f6:50"/>
Apr 12 06:54:05 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:54:05 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:54:05 user nova-compute[71711]:       <target dev="tap195ab8fb-eb"/>
Apr 12 06:54:05 user nova-compute[71711]:     </interface>
Apr 12 06:54:05 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:54:05 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/console.log" append="off"/>
Apr 12 06:54:05 user nova-compute[71711]:     </serial>
Apr 12 06:54:05 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:54:05 user nova-compute[71711]:     <video>
Apr 12 06:54:05 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:54:05 user nova-compute[71711]:     </video>
Apr 12 06:54:05 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:54:05 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:54:05 user nova-compute[71711]:     </rng>
Apr 12 06:54:05 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:54:05 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:54:05 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:54:05 user nova-compute[71711]:     </memballoon>
Apr 12 06:54:05 user nova-compute[71711]:   </devices>
Apr 12 06:54:05 user nova-compute[71711]: </domain>
Apr 12 06:54:05 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1061983954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1061983954',id=43,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZatAJqhPRKbsg3G5XFC/JkrKoFRPA+0R2UIBKzFMOJlUFJ6rJIELVTlaoiATccS59Gqp4lgra8q75tm0fDyDA6b//ESxqIoXD4S2MxQGGB56gMpEm5qcZHQfzxVjPWzQ==',key_name='tempest-keypair-1503210292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76a8460ce5c24d1db20e80a1659133f7',ramdisk_id='',reservation_id='r-a0bmlrhx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1986658224',owner_user_name='tempest-AttachVolumeShelveTestJSON-1986658224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fbb8c37e5a74a0b83011c2a21033204',uuid=3666a910-9199-4582-8eb7-7b3b6263a535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converting VIF {"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG os_vif [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap195ab8fb-eb, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:54:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap195ab8fb-eb, col_values=(('external_ids', {'iface-id': '195ab8fb-eb21-4623-806e-6f8ff7a6f2ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:f6:50', 'vm-uuid': '3666a910-9199-4582-8eb7-7b3b6263a535'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:54:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:54:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:06 user nova-compute[71711]: INFO os_vif [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb')
Apr 12 06:54:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:54:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:54:06 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:54:06 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] No VIF found with MAC fa:16:3e:87:f6:50, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:54:06 user nova-compute[71711]: DEBUG nova.network.neutron [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updated VIF entry in instance network info cache for port 195ab8fb-eb21-4623-806e-6f8ff7a6f2ea. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:54:06 user nova-compute[71711]: DEBUG nova.network.neutron [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updating instance_info_cache with network_info: [{"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:54:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-dc1710ff-852e-412c-9898-81f6c5d03472 req-09047b8e-0ae8-4d6a-ad5f-8d2d63b1fd77 service nova] Releasing lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:54:07 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:54:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:07 user nova-compute[71711]: DEBUG nova.compute.manager [req-dff2c3b7-ebfa-40a3-b495-4d5ac7790e1a req-1ae8b584-ae6a-4d41-be51-a3b6c83f39e2 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:54:07 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-dff2c3b7-ebfa-40a3-b495-4d5ac7790e1a req-1ae8b584-ae6a-4d41-be51-a3b6c83f39e2 service nova] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:07 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-dff2c3b7-ebfa-40a3-b495-4d5ac7790e1a req-1ae8b584-ae6a-4d41-be51-a3b6c83f39e2 service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:07 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-dff2c3b7-ebfa-40a3-b495-4d5ac7790e1a req-1ae8b584-ae6a-4d41-be51-a3b6c83f39e2 service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:07 user nova-compute[71711]: DEBUG nova.compute.manager [req-dff2c3b7-ebfa-40a3-b495-4d5ac7790e1a req-1ae8b584-ae6a-4d41-be51-a3b6c83f39e2 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] No waiting events found dispatching network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:54:07 user nova-compute[71711]: WARNING nova.compute.manager [req-dff2c3b7-ebfa-40a3-b495-4d5ac7790e1a req-1ae8b584-ae6a-4d41-be51-a3b6c83f39e2 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received unexpected event network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance with vm_state building and task_state spawning.
Apr 12 06:54:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282449.5371778, 3666a910-9199-4582-8eb7-7b3b6263a535 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:54:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] VM Resumed (Lifecycle Event)
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:54:09 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Instance spawned successfully.
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.compute.manager [req-ea143224-d998-4388-b862-28e746e37638 req-944f0143-f079-4f87-8750-921362260536 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ea143224-d998-4388-b862-28e746e37638 req-944f0143-f079-4f87-8750-921362260536 service nova] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ea143224-d998-4388-b862-28e746e37638 req-944f0143-f079-4f87-8750-921362260536 service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-ea143224-d998-4388-b862-28e746e37638 req-944f0143-f079-4f87-8750-921362260536 service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.compute.manager [req-ea143224-d998-4388-b862-28e746e37638 req-944f0143-f079-4f87-8750-921362260536 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] No waiting events found dispatching network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:54:09 user nova-compute[71711]: WARNING nova.compute.manager [req-ea143224-d998-4388-b862-28e746e37638 req-944f0143-f079-4f87-8750-921362260536 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received unexpected event network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance with vm_state building and task_state spawning.
Apr 12 06:54:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282449.540408, 3666a910-9199-4582-8eb7-7b3b6263a535 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:54:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] VM Started (Lifecycle Event)
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:54:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:09 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:54:09 user nova-compute[71711]: INFO nova.compute.manager [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Took 5.58 seconds to spawn the instance on the hypervisor.
Apr 12 06:54:09 user nova-compute[71711]: DEBUG nova.compute.manager [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:54:09 user nova-compute[71711]: INFO nova.compute.manager [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Took 6.15 seconds to build instance.
Apr 12 06:54:09 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-61093ec6-59e9-4ec8-a939-0659e085067b tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "3666a910-9199-4582-8eb7-7b3b6263a535" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.251s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "d338017f-0ae6-42dd-8015-68522ff99de8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "d338017f-0ae6-42dd-8015-68522ff99de8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:54:10 user nova-compute[71711]: INFO nova.compute.claims [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Claim successful on node user
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:10 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:54:10 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:54:10 user nova-compute[71711]: INFO nova.virt.block_device [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Booting with volume snapshot d8878eba-66cc-4e86-a34a-d46c8c7499ea at /dev/vda
Apr 12 06:54:10 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:54:10 user nova-compute[71711]: DEBUG nova.policy [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:11 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:54:11 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:54:11 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8543MB free_disk=26.12612533569336GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 3666a910-9199-4582-8eb7-7b3b6263a535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance d338017f-0ae6-42dd-8015-68522ff99de8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Successfully created port: 97277a3a-a7de-4c39-8a7e-9fc88572f072 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:54:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Successfully updated port: 97277a3a-a7de-4c39-8a7e-9fc88572f072 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "refresh_cache-d338017f-0ae6-42dd-8015-68522ff99de8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquired lock "refresh_cache-d338017f-0ae6-42dd-8015-68522ff99de8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Received event network-changed-97277a3a-a7de-4c39-8a7e-9fc88572f072 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG nova.compute.manager [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Refreshing instance network info cache due to event network-changed-97277a3a-a7de-4c39-8a7e-9fc88572f072. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] Acquiring lock "refresh_cache-d338017f-0ae6-42dd-8015-68522ff99de8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Updating instance_info_cache with network_info: [{"id": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "address": "fa:16:3e:9f:32:13", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97277a3a-a7", "ovs_interfaceid": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Skipping network cache update for instance because it is Building. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Releasing lock "refresh_cache-d338017f-0ae6-42dd-8015-68522ff99de8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Instance network_info: |[{"id": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "address": "fa:16:3e:9f:32:13", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97277a3a-a7", "ovs_interfaceid": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] Acquired lock "refresh_cache-d338017f-0ae6-42dd-8015-68522ff99de8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG nova.network.neutron [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Refreshing network info cache for port 97277a3a-a7de-4c39-8a7e-9fc88572f072 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-e13297b8-5f8a-46e8-8793-a092b5b4fc9e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-e13297b8-5f8a-46e8-8793-a092b5b4fc9e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:54:12 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid e13297b8-5f8a-46e8-8793-a092b5b4fc9e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:54:13 user nova-compute[71711]: DEBUG nova.network.neutron [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Updated VIF entry in instance network info cache for port 97277a3a-a7de-4c39-8a7e-9fc88572f072. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:54:13 user nova-compute[71711]: DEBUG nova.network.neutron [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Updating instance_info_cache with network_info: [{"id": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "address": "fa:16:3e:9f:32:13", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97277a3a-a7", "ovs_interfaceid": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:54:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-384e1581-4723-4009-8f8b-88448edd02fc req-640941a6-4b9d-4cdf-90a0-9f6277e833ac service nova] Releasing lock "refresh_cache-d338017f-0ae6-42dd-8015-68522ff99de8" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:54:13 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Updating instance_info_cache with network_info: [{"id": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "address": "fa:16:3e:4f:38:76", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d92724c-b2", "ovs_interfaceid": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:54:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-e13297b8-5f8a-46e8-8793-a092b5b4fc9e" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:54:13 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:54:13 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:54:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:15 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG os_brick.utils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[74304d9d-2a8b-48d7-b4cd-6afcb2352bd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[30207fad-17c8-479c-9753-2075b492b181]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e7f24f-490b-4ae3-9e73-c524a0d4eaff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[646bddad-ae35-4db0-8552-511b0f5cf3a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:54:16 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:54:16 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ceedec-bea8-40b6-b99e-2c3e96529615]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG os_brick.utils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:54:16 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Updating existing volume attachment record: 5cb99134-2017-4ec9-9483-f22723a7bd47 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:54:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:54:21 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Creating image(s)
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Ensure instance console log exists: /opt/stack/data/nova/instances/d338017f-0ae6-42dd-8015-68522ff99de8/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Start _get_guest_xml network_info=[{"id": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "address": "fa:16:3e:9f:32:13", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97277a3a-a7", "ovs_interfaceid": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T06:54:08Z,direct_url=<?>,disk_format='qcow2',id=0e1f547a-cb9b-4ce7-852c-deedf527cce8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-943632025',owner='13d1513e8b784c758412ddfc2692bb22',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T06:54:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'venidAmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd338017f-0ae6-42dd-8015-68522ff99de8', 'attached_at': '', 'detached_at': '', 'volume_id': '9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'serial': '9659873a-a3f8-4402-ac09-ffa6dee6c8ad'}, 'attachment_id': '5cb99134-2017-4ec9-9483-f22723a7bd47', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:54:21 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:54:21 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T06:54:08Z,direct_url=<?>,disk_format='qcow2',id=0e1f547a-cb9b-4ce7-852c-deedf527cce8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-943632025',owner='13d1513e8b784c758412ddfc2692bb22',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T06:54:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'venidAmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:54:21 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:54:21 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:54:21 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f7646b-1e37-408e-a634-c3b6ba868357]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:54:21 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[76401699-22a0-4375-92b2-39fbf63bff9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad] added
Apr 12 06:54:21 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7b710d-f634-47a9-bde5-7835fec98fa9]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0b0219-28ca-49c1-98c7-fc184431e6c3]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v venidAmR {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v venidAmR" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cf1f78-76ed-4869-bcc3-72da2d04e8e2]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'venidAmR'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[03efa2ac-bae7-4de6-b15b-0340409f026f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8f2d94-632b-4d96-bda1-5e15266c4085]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:54:21 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:54:21 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acbac87-cd74-4657-a34f-68697fc8fd9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad, portal: 172.16.0.220,3260]
Apr 12 06:54:21 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad, portal: 172.16.0.220,3260] successful.
Apr 12 06:54:21 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80a9cf1-9c03-4173-909a-e388753b1bdc]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa2e9a4-0a53-47a8-982f-d3075a8b5745]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:54:21 user nova-compute[71711]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad (non-flash)
Apr 12 06:54:21 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:54:21 user nova-compute[71711]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad (non-flash)
Apr 12 06:54:21 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4dc6ce-0f24-4169-8564-884c3d50e0d9]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:54:21 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'venidAmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26432633663383766', 'path': '/dev/sdc'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432633663383766', 'path': '/dev/sdc'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:54:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1691787741',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1691787741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1691787741',id=44,image_ref='0e1f547a-cb9b-4ce7-852c-deedf527cce8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-85hehd0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-294210775',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:54:11Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=d338017f-0ae6-42dd-8015-68522ff99de8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "address": "fa:16:3e:9f:32:13", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97277a3a-a7", "ovs_interfaceid": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "address": "fa:16:3e:9f:32:13", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97277a3a-a7", "ovs_interfaceid": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:32:13,bridge_name='br-int',has_traffic_filtering=True,id=97277a3a-a7de-4c39-8a7e-9fc88572f072,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97277a3a-a7') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG nova.objects.instance [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lazy-loading 'pci_devices' on Instance uuid d338017f-0ae6-42dd-8015-68522ff99de8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:54:22 user nova-compute[71711]:   <uuid>d338017f-0ae6-42dd-8015-68522ff99de8</uuid>
Apr 12 06:54:22 user nova-compute[71711]:   <name>instance-0000002c</name>
Apr 12 06:54:22 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:54:22 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:54:22 user nova-compute[71711]:   <metadata>
Apr 12 06:54:22 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:54:22 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:54:22 user nova-compute[71711]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1691787741</nova:name>
Apr 12 06:54:22 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:54:21</nova:creationTime>
Apr 12 06:54:22 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:54:22 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:54:22 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:54:22 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:54:22 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:54:22 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:54:22 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:54:22 user nova-compute[71711]:       <nova:owner>
Apr 12 06:54:22 user nova-compute[71711]:         <nova:user uuid="1fec39f776464d339142eeed1ba95a6d">tempest-TestVolumeBootPattern-294210775-project-member</nova:user>
Apr 12 06:54:22 user nova-compute[71711]:         <nova:project uuid="13d1513e8b784c758412ddfc2692bb22">tempest-TestVolumeBootPattern-294210775</nova:project>
Apr 12 06:54:22 user nova-compute[71711]:       </nova:owner>
Apr 12 06:54:22 user nova-compute[71711]:       <nova:root type="image" uuid="0e1f547a-cb9b-4ce7-852c-deedf527cce8"/>
Apr 12 06:54:22 user nova-compute[71711]:       <nova:ports>
Apr 12 06:54:22 user nova-compute[71711]:         <nova:port uuid="97277a3a-a7de-4c39-8a7e-9fc88572f072">
Apr 12 06:54:22 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 06:54:22 user nova-compute[71711]:         </nova:port>
Apr 12 06:54:22 user nova-compute[71711]:       </nova:ports>
Apr 12 06:54:22 user nova-compute[71711]:     </nova:instance>
Apr 12 06:54:22 user nova-compute[71711]:   </metadata>
Apr 12 06:54:22 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:54:22 user nova-compute[71711]:     <system>
Apr 12 06:54:22 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:54:22 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:54:22 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:54:22 user nova-compute[71711]:       <entry name="serial">d338017f-0ae6-42dd-8015-68522ff99de8</entry>
Apr 12 06:54:22 user nova-compute[71711]:       <entry name="uuid">d338017f-0ae6-42dd-8015-68522ff99de8</entry>
Apr 12 06:54:22 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:54:22 user nova-compute[71711]:     </system>
Apr 12 06:54:22 user nova-compute[71711]:   </sysinfo>
Apr 12 06:54:22 user nova-compute[71711]:   <os>
Apr 12 06:54:22 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:54:22 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:54:22 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:54:22 user nova-compute[71711]:   </os>
Apr 12 06:54:22 user nova-compute[71711]:   <features>
Apr 12 06:54:22 user nova-compute[71711]:     <acpi/>
Apr 12 06:54:22 user nova-compute[71711]:     <apic/>
Apr 12 06:54:22 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:54:22 user nova-compute[71711]:   </features>
Apr 12 06:54:22 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:54:22 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:54:22 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:54:22 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:54:22 user nova-compute[71711]:   </clock>
Apr 12 06:54:22 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:54:22 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:54:22 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:54:22 user nova-compute[71711]:   </cpu>
Apr 12 06:54:22 user nova-compute[71711]:   <devices>
Apr 12 06:54:22 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:54:22 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:54:22 user nova-compute[71711]:       <source dev="/dev/sdc"/>
Apr 12 06:54:22 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:54:22 user nova-compute[71711]:       <serial>9659873a-a3f8-4402-ac09-ffa6dee6c8ad</serial>
Apr 12 06:54:22 user nova-compute[71711]:     </disk>
Apr 12 06:54:22 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:54:22 user nova-compute[71711]:       <mac address="fa:16:3e:9f:32:13"/>
Apr 12 06:54:22 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:54:22 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:54:22 user nova-compute[71711]:       <target dev="tap97277a3a-a7"/>
Apr 12 06:54:22 user nova-compute[71711]:     </interface>
Apr 12 06:54:22 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:54:22 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/d338017f-0ae6-42dd-8015-68522ff99de8/console.log" append="off"/>
Apr 12 06:54:22 user nova-compute[71711]:     </serial>
Apr 12 06:54:22 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:54:22 user nova-compute[71711]:     <video>
Apr 12 06:54:22 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:54:22 user nova-compute[71711]:     </video>
Apr 12 06:54:22 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:54:22 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:54:22 user nova-compute[71711]:     </rng>
Apr 12 06:54:22 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:54:22 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:54:22 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:54:22 user nova-compute[71711]:     </memballoon>
Apr 12 06:54:22 user nova-compute[71711]:   </devices>
Apr 12 06:54:22 user nova-compute[71711]: </domain>
Apr 12 06:54:22 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:54:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1691787741',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1691787741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1691787741',id=44,image_ref='0e1f547a-cb9b-4ce7-852c-deedf527cce8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-85hehd0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-294210775',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:54:11Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=d338017f-0ae6-42dd-8015-68522ff99de8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "address": "fa:16:3e:9f:32:13", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97277a3a-a7", "ovs_interfaceid": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "address": "fa:16:3e:9f:32:13", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97277a3a-a7", "ovs_interfaceid": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:32:13,bridge_name='br-int',has_traffic_filtering=True,id=97277a3a-a7de-4c39-8a7e-9fc88572f072,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97277a3a-a7') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG os_vif [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:32:13,bridge_name='br-int',has_traffic_filtering=True,id=97277a3a-a7de-4c39-8a7e-9fc88572f072,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97277a3a-a7') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97277a3a-a7, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97277a3a-a7, col_values=(('external_ids', {'iface-id': '97277a3a-a7de-4c39-8a7e-9fc88572f072', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:32:13', 'vm-uuid': 'd338017f-0ae6-42dd-8015-68522ff99de8'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:22 user nova-compute[71711]: INFO os_vif [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:32:13,bridge_name='br-int',has_traffic_filtering=True,id=97277a3a-a7de-4c39-8a7e-9fc88572f072,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97277a3a-a7')
Apr 12 06:54:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:54:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] No VIF found with MAC fa:16:3e:9f:32:13, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:54:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:24 user nova-compute[71711]: DEBUG nova.compute.manager [req-fb3bab2f-7a15-4777-8edd-246f3164e977 req-70b4800b-69c3-4ac2-adbe-c5d0ea4ea47a service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Received event network-vif-plugged-97277a3a-a7de-4c39-8a7e-9fc88572f072 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:54:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fb3bab2f-7a15-4777-8edd-246f3164e977 req-70b4800b-69c3-4ac2-adbe-c5d0ea4ea47a service nova] Acquiring lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fb3bab2f-7a15-4777-8edd-246f3164e977 req-70b4800b-69c3-4ac2-adbe-c5d0ea4ea47a service nova] Lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-fb3bab2f-7a15-4777-8edd-246f3164e977 req-70b4800b-69c3-4ac2-adbe-c5d0ea4ea47a service nova] Lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:24 user nova-compute[71711]: DEBUG nova.compute.manager [req-fb3bab2f-7a15-4777-8edd-246f3164e977 req-70b4800b-69c3-4ac2-adbe-c5d0ea4ea47a service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] No waiting events found dispatching network-vif-plugged-97277a3a-a7de-4c39-8a7e-9fc88572f072 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:54:24 user nova-compute[71711]: WARNING nova.compute.manager [req-fb3bab2f-7a15-4777-8edd-246f3164e977 req-70b4800b-69c3-4ac2-adbe-c5d0ea4ea47a service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Received unexpected event network-vif-plugged-97277a3a-a7de-4c39-8a7e-9fc88572f072 for instance with vm_state building and task_state spawning.
Apr 12 06:54:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.compute.manager [req-2236354b-e806-4d8e-87ba-5ec75e54de8f req-7a88a4b5-3ee2-4b4f-9251-a851ea14f5b0 service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Received event network-vif-plugged-97277a3a-a7de-4c39-8a7e-9fc88572f072 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:54:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2236354b-e806-4d8e-87ba-5ec75e54de8f req-7a88a4b5-3ee2-4b4f-9251-a851ea14f5b0 service nova] Acquiring lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:54:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2236354b-e806-4d8e-87ba-5ec75e54de8f req-7a88a4b5-3ee2-4b4f-9251-a851ea14f5b0 service nova] Lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:54:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2236354b-e806-4d8e-87ba-5ec75e54de8f req-7a88a4b5-3ee2-4b4f-9251-a851ea14f5b0 service nova] Lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.compute.manager [req-2236354b-e806-4d8e-87ba-5ec75e54de8f req-7a88a4b5-3ee2-4b4f-9251-a851ea14f5b0 service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] No waiting events found dispatching network-vif-plugged-97277a3a-a7de-4c39-8a7e-9fc88572f072 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:54:26 user nova-compute[71711]: WARNING nova.compute.manager [req-2236354b-e806-4d8e-87ba-5ec75e54de8f req-7a88a4b5-3ee2-4b4f-9251-a851ea14f5b0 service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Received unexpected event network-vif-plugged-97277a3a-a7de-4c39-8a7e-9fc88572f072 for instance with vm_state building and task_state spawning.
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282466.217557, d338017f-0ae6-42dd-8015-68522ff99de8 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:54:26 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] VM Resumed (Lifecycle Event)
Apr 12 06:54:26 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Instance spawned successfully.
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:54:26 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282466.2181177, d338017f-0ae6-42dd-8015-68522ff99de8 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:54:26 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] VM Started (Lifecycle Event)
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:54:26 user nova-compute[71711]: INFO nova.compute.manager [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Took 5.02 seconds to spawn the instance on the hypervisor.
Apr 12 06:54:26 user nova-compute[71711]: DEBUG nova.compute.manager [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:54:26 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:54:26 user nova-compute[71711]: INFO nova.compute.manager [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Took 16.20 seconds to build instance.
Apr 12 06:54:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-2951af4a-7168-44c5-9948-e3fb34cc31fb tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "d338017f-0ae6-42dd-8015-68522ff99de8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.296s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:54:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:54:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:54:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:54:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:54:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:54:57 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:54:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:55:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:55:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:55:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:55:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:55:07 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:55:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:55:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:55:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:55:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:55:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:08 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:55:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:10 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:55:10 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:55:11 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:55:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:55:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:55:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:55:11 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:55:11 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updating instance_info_cache with network_info: [{"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:55:11 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:55:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:55:12 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:55:13 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:55:13 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:55:13 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8479MB free_disk=26.08904266357422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:55:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:55:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:55:13 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:55:13 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:55:13 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 3666a910-9199-4582-8eb7-7b3b6263a535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:55:13 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance d338017f-0ae6-42dd-8015-68522ff99de8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:55:13 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:55:13 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:55:13 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:55:13 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:55:13 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:55:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:55:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:55:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:55:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:55:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:55:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:55:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:55:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:55:17 user nova-compute[71711]: DEBUG nova.objects.instance [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'flavor' on Instance uuid 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:55:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:55:18 user nova-compute[71711]: INFO nova.compute.manager [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Attaching volume 98d566ec-564b-4062-9a9a-09066ee60704 to /dev/vdb
Apr 12 06:55:18 user nova-compute[71711]: DEBUG os_brick.utils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36f6de9-6609-4196-9cd1-55ef006ee105]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ed378b-fe56-4115-8a68-0c30d3e3e7c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[58735826-26b2-454e-900f-95efa857e9a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bed27d9-2894-4e0d-bd86-3ad09e463933]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:55:18 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:55:18 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a55834-5fe8-4984-b52e-5f35089b9dd1]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG os_brick.utils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:55:18 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updating existing volume attachment record: 776d2056-7ee7-48bd-9a5b-e8eea1485e29 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRuFkeig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:55:22 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:55:22 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:55:22 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cdc18b-a7e0-473d-a279-2902c0dce37b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:55:22 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e486658-4758-4952-be1a-9c2011ccab03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704] added
Apr 12 06:55:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[39291bc6-8cfc-4fde-a87d-86b8121f355d]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f772feb2-fbac-43ae-9cf5-d49caefacc72]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRuFkeig {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRuFkeig" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[de587ac5-c02a-4303-a0b3-621ce8d146fe]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KRuFkeig'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dc8ef7-52f6-4b2e-8663-a308080d2c2a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7087f11e-9875-4ede-9415-da1acefb9bcf]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:55:22 user nova-compute[71711]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad (non-flash)
Apr 12 06:55:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:55:22 user nova-compute[71711]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad (non-flash)
Apr 12 06:55:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab6c861-da42-4ba5-a815-ca293ba1518e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704, portal: 172.16.0.220,3260]
Apr 12 06:55:22 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704, portal: 172.16.0.220,3260] successful.
Apr 12 06:55:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee143601-0d65-4635-8fa9-779d96532ed4]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1d0cfd-f12b-4520-bcc3-e1e9840c5982]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:55:22 user nova-compute[71711]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad (non-flash)
Apr 12 06:55:22 user nova-compute[71711]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 (non-flash)
Apr 12 06:55:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:55:22 user nova-compute[71711]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad (non-flash)
Apr 12 06:55:22 user nova-compute[71711]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 (non-flash)
Apr 12 06:55:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b947697f-131d-4f83-b780-b1bce73eb654]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:55:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:55:23 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:55:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRuFkeig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:55:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:55:23 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23736626535396538', 'path': '/dev/sdd'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:55:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736626535396538', 'path': '/dev/sdd'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:55:23 user nova-compute[71711]: DEBUG nova.objects.instance [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'flavor' on Instance uuid 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:55:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 06:55:23 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:55:23 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:55:23 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:55:23 user nova-compute[71711]:   <serial>98d566ec-564b-4062-9a9a-09066ee60704</serial>
Apr 12 06:55:23 user nova-compute[71711]: </disk>
Apr 12 06:55:23 user nova-compute[71711]:  {{(pid=71711) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 06:55:24 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:55:24 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:55:24 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] No VIF found with MAC fa:16:3e:29:b6:18, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:55:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a688c63-f92b-4210-8416-35455a8bb8b0 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.440s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:55:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-changed-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:55:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Refreshing instance network info cache due to event network-changed-b99eaecc-c588-46cb-84bf-10c63272eebf. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:55:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] Acquiring lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:55:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] Acquired lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:55:27 user nova-compute[71711]: DEBUG nova.network.neutron [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Refreshing network info cache for port b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:55:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:27 user nova-compute[71711]: DEBUG nova.network.neutron [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updated VIF entry in instance network info cache for port b99eaecc-c588-46cb-84bf-10c63272eebf. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:55:27 user nova-compute[71711]: DEBUG nova.network.neutron [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updating instance_info_cache with network_info: [{"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:55:27 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9f833f0a-b774-4b70-957f-8764fa8cdd88 req-5333a42d-bce3-4b53-9172-e57045d99e97 service nova] Releasing lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:55:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-changed-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:55:29 user nova-compute[71711]: DEBUG nova.compute.manager [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Refreshing instance network info cache due to event network-changed-b99eaecc-c588-46cb-84bf-10c63272eebf. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:55:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] Acquiring lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:55:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] Acquired lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:55:29 user nova-compute[71711]: DEBUG nova.network.neutron [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Refreshing network info cache for port b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:55:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:55:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:55:29 user nova-compute[71711]: INFO nova.compute.manager [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Rebooting instance
Apr 12 06:55:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:55:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:29 user nova-compute[71711]: DEBUG nova.network.neutron [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updated VIF entry in instance network info cache for port b99eaecc-c588-46cb-84bf-10c63272eebf. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:55:29 user nova-compute[71711]: DEBUG nova.network.neutron [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updating instance_info_cache with network_info: [{"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:55:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9387600c-658b-4d81-9581-f2a921833a1a req-77898373-4278-42d3-ae4f-d59536931db7 service nova] Releasing lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:55:29 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquired lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:55:29 user nova-compute[71711]: DEBUG nova.network.neutron [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:55:30 user nova-compute[71711]: DEBUG nova.network.neutron [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updating instance_info_cache with network_info: [{"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:55:30 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Releasing lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:55:30 user nova-compute[71711]: DEBUG nova.compute.manager [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:55:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:32 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3c2de76-b16c-4e6d-ac75-5ebf4515fce1 req-98d286bd-be86-4165-82b2-ed3284ed79fd service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-vif-unplugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:55:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c2de76-b16c-4e6d-ac75-5ebf4515fce1 req-98d286bd-be86-4165-82b2-ed3284ed79fd service nova] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:55:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c2de76-b16c-4e6d-ac75-5ebf4515fce1 req-98d286bd-be86-4165-82b2-ed3284ed79fd service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:55:32 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a3c2de76-b16c-4e6d-ac75-5ebf4515fce1 req-98d286bd-be86-4165-82b2-ed3284ed79fd service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:55:32 user nova-compute[71711]: DEBUG nova.compute.manager [req-a3c2de76-b16c-4e6d-ac75-5ebf4515fce1 req-98d286bd-be86-4165-82b2-ed3284ed79fd service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] No waiting events found dispatching network-vif-unplugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:55:32 user nova-compute[71711]: WARNING nova.compute.manager [req-a3c2de76-b16c-4e6d-ac75-5ebf4515fce1 req-98d286bd-be86-4165-82b2-ed3284ed79fd service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received unexpected event network-vif-unplugged-b99eaecc-c588-46cb-84bf-10c63272eebf for instance with vm_state active and task_state reboot_started.
Apr 12 06:55:33 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Instance shutdown successfully.
Apr 12 06:55:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:55:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:55:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:55:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:55:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] No waiting events found dispatching network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:55:34 user nova-compute[71711]: WARNING nova.compute.manager [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received unexpected event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf for instance with vm_state active and task_state reboot_started.
Apr 12 06:55:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:55:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:55:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:55:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:55:34 user nova-compute[71711]: DEBUG nova.compute.manager [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] No waiting events found dispatching network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:55:34 user nova-compute[71711]: WARNING nova.compute.manager [req-3d757b93-f16d-42a3-a7e0-985ca9590059 req-e110e918-7cb9-44c2-b548-91ceff964857 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received unexpected event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf for instance with vm_state active and task_state reboot_started.
Apr 12 06:55:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.host [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Removed pending event for 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 due to event {{(pid=71711) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 06:55:36 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282536.7318153, 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:55:36 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] VM Resumed (Lifecycle Event)
Apr 12 06:55:36 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Instance running successfully.
Apr 12 06:55:36 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Instance soft rebooted successfully.
Apr 12 06:55:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:55:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:55:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:55:36 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 12 06:55:36 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282536.7332761, 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:55:36 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] VM Started (Lifecycle Event)
Apr 12 06:55:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:55:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0cf416a6-261e-4aa1-8149-0dfd34f0b126 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.300s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:55:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:55:36 user nova-compute[71711]: DEBUG nova.compute.manager [req-90edd1c5-bc8b-48d8-98e6-4939e0cf3c14 req-c534f3e1-4136-4526-88dd-a965462a93bf service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:55:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-90edd1c5-bc8b-48d8-98e6-4939e0cf3c14 req-c534f3e1-4136-4526-88dd-a965462a93bf service nova] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:55:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-90edd1c5-bc8b-48d8-98e6-4939e0cf3c14 req-c534f3e1-4136-4526-88dd-a965462a93bf service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:55:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-90edd1c5-bc8b-48d8-98e6-4939e0cf3c14 req-c534f3e1-4136-4526-88dd-a965462a93bf service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:55:36 user nova-compute[71711]: DEBUG nova.compute.manager [req-90edd1c5-bc8b-48d8-98e6-4939e0cf3c14 req-c534f3e1-4136-4526-88dd-a965462a93bf service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] No waiting events found dispatching network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:55:36 user nova-compute[71711]: WARNING nova.compute.manager [req-90edd1c5-bc8b-48d8-98e6-4939e0cf3c14 req-c534f3e1-4136-4526-88dd-a965462a93bf service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received unexpected event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf for instance with vm_state active and task_state None.
Apr 12 06:55:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-changed-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:55:54 user nova-compute[71711]: DEBUG nova.compute.manager [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Refreshing instance network info cache due to event network-changed-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:55:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] Acquiring lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:55:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] Acquired lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:55:54 user nova-compute[71711]: DEBUG nova.network.neutron [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Refreshing network info cache for port 195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:55:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:54 user nova-compute[71711]: DEBUG nova.network.neutron [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updated VIF entry in instance network info cache for port 195ab8fb-eb21-4623-806e-6f8ff7a6f2ea. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:55:54 user nova-compute[71711]: DEBUG nova.network.neutron [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updating instance_info_cache with network_info: [{"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:55:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b9562711-761f-4e1c-aefb-01257ed33e70 req-b14c540a-78ea-4fe1-b7bc-f5c864a22c60 service nova] Releasing lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:55:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:55:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "3666a910-9199-4582-8eb7-7b3b6263a535" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:55:56 user nova-compute[71711]: INFO nova.compute.manager [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Shelving
Apr 12 06:55:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-2bf906d7-f8e2-4fd9-8f1f-835eaf1f00f5 req-47ff70d3-3610-449d-b851-f6c608c3d06a service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-vif-unplugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:55:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2bf906d7-f8e2-4fd9-8f1f-835eaf1f00f5 req-47ff70d3-3610-449d-b851-f6c608c3d06a service nova] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:55:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2bf906d7-f8e2-4fd9-8f1f-835eaf1f00f5 req-47ff70d3-3610-449d-b851-f6c608c3d06a service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:55:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2bf906d7-f8e2-4fd9-8f1f-835eaf1f00f5 req-47ff70d3-3610-449d-b851-f6c608c3d06a service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:55:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-2bf906d7-f8e2-4fd9-8f1f-835eaf1f00f5 req-47ff70d3-3610-449d-b851-f6c608c3d06a service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] No waiting events found dispatching network-vif-unplugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:55:56 user nova-compute[71711]: WARNING nova.compute.manager [req-2bf906d7-f8e2-4fd9-8f1f-835eaf1f00f5 req-47ff70d3-3610-449d-b851-f6c608c3d06a service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received unexpected event network-vif-unplugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance with vm_state active and task_state shelving.
Apr 12 06:55:57 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Instance destroyed successfully.
Apr 12 06:55:57 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Beginning cold snapshot process
Apr 12 06:55:57 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:55:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk /opt/stack/data/nova/instances/snapshots/tmp1z5b9bx4/3f80afea7e3647e996dc546a634eb8c9 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:55:57 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk /opt/stack/data/nova/instances/snapshots/tmp1z5b9bx4/3f80afea7e3647e996dc546a634eb8c9" returned: 0 in 0.304s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:55:57 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Snapshot extracted, beginning image upload
Apr 12 06:55:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-336cf05a-f7cf-4c25-a0e1-21376b181b06 req-daded8b8-9e0f-4d56-8c59-2f0b5c107263 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:55:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-336cf05a-f7cf-4c25-a0e1-21376b181b06 req-daded8b8-9e0f-4d56-8c59-2f0b5c107263 service nova] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:55:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-336cf05a-f7cf-4c25-a0e1-21376b181b06 req-daded8b8-9e0f-4d56-8c59-2f0b5c107263 service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:55:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-336cf05a-f7cf-4c25-a0e1-21376b181b06 req-daded8b8-9e0f-4d56-8c59-2f0b5c107263 service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:55:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-336cf05a-f7cf-4c25-a0e1-21376b181b06 req-daded8b8-9e0f-4d56-8c59-2f0b5c107263 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] No waiting events found dispatching network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:55:58 user nova-compute[71711]: WARNING nova.compute.manager [req-336cf05a-f7cf-4c25-a0e1-21376b181b06 req-daded8b8-9e0f-4d56-8c59-2f0b5c107263 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received unexpected event network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 06:55:59 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:55:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:55:59 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Snapshot image upload complete
Apr 12 06:55:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:55:59 user nova-compute[71711]: INFO nova.compute.manager [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Shelve offloading
Apr 12 06:55:59 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Instance destroyed successfully.
Apr 12 06:55:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:55:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:55:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquired lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:55:59 user nova-compute[71711]: DEBUG nova.network.neutron [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.network.neutron [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updating instance_info_cache with network_info: [{"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Releasing lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "d338017f-0ae6-42dd-8015-68522ff99de8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "d338017f-0ae6-42dd-8015-68522ff99de8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:00 user nova-compute[71711]: INFO nova.compute.manager [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Terminating instance
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:00 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Instance destroyed successfully.
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.objects.instance [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'resources' on Instance uuid 3666a910-9199-4582-8eb7-7b3b6263a535 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Received event network-vif-unplugged-97277a3a-a7de-4c39-8a7e-9fc88572f072 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] Acquiring lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] Lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] Lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] No waiting events found dispatching network-vif-unplugged-97277a3a-a7de-4c39-8a7e-9fc88572f072 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Received event network-vif-unplugged-97277a3a-a7de-4c39-8a7e-9fc88572f072 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Received event network-vif-plugged-97277a3a-a7de-4c39-8a7e-9fc88572f072 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] Acquiring lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] Lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] Lock "d338017f-0ae6-42dd-8015-68522ff99de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] No waiting events found dispatching network-vif-plugged-97277a3a-a7de-4c39-8a7e-9fc88572f072 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:56:00 user nova-compute[71711]: WARNING nova.compute.manager [req-947ac34f-ecd7-49cb-852d-5ecf93932567 req-44aa1dc2-79ae-49ca-a20b-c4f7b31208d1 service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Received unexpected event network-vif-plugged-97277a3a-a7de-4c39-8a7e-9fc88572f072 for instance with vm_state active and task_state deleting.
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1061983954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1061983954',id=43,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZatAJqhPRKbsg3G5XFC/JkrKoFRPA+0R2UIBKzFMOJlUFJ6rJIELVTlaoiATccS59Gqp4lgra8q75tm0fDyDA6b//ESxqIoXD4S2MxQGGB56gMpEm5qcZHQfzxVjPWzQ==',key_name='tempest-keypair-1503210292',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:54:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='76a8460ce5c24d1db20e80a1659133f7',ramdisk_id='',reservation_id='r-a0bmlrhx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1986658224',owner_user_name='tempest-AttachVolumeShelveTestJSON-1986658224-project-member',shelved_at='2023-04-12T06:55:59.786476',shelved_host='user',shelved_image_id='c8035aa5-0ef9-4a56-8190-706937c81a93'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fbb8c37e5a74a0b83011c2a21033204',uuid=3666a910-9199-4582-8eb7-7b3b6263a535,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converting VIF {"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG os_vif [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap195ab8fb-eb, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-changed-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.compute.manager [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Refreshing instance network info cache due to event network-changed-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] Acquiring lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] Acquired lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG nova.network.neutron [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Refreshing network info cache for port 195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:56:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:00 user nova-compute[71711]: INFO os_vif [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb')
Apr 12 06:56:00 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Deleting instance files /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535_del
Apr 12 06:56:00 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Deletion of /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535_del complete
Apr 12 06:56:01 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Deleted allocations for instance 3666a910-9199-4582-8eb7-7b3b6263a535
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG nova.objects.instance [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'numa_topology' on Instance uuid 3666a910-9199-4582-8eb7-7b3b6263a535 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:56:01 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Instance destroyed successfully.
Apr 12 06:56:01 user nova-compute[71711]: DEBUG nova.objects.instance [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lazy-loading 'resources' on Instance uuid d338017f-0ae6-42dd-8015-68522ff99de8 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:54:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1691787741',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1691787741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1691787741',id=44,image_ref='0e1f547a-cb9b-4ce7-852c-deedf527cce8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:54:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-85hehd0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-294210775',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:54:26Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=d338017f-0ae6-42dd-8015-68522ff99de8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "address": "fa:16:3e:9f:32:13", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97277a3a-a7", "ovs_interfaceid": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "address": "fa:16:3e:9f:32:13", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97277a3a-a7", "ovs_interfaceid": "97277a3a-a7de-4c39-8a7e-9fc88572f072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:32:13,bridge_name='br-int',has_traffic_filtering=True,id=97277a3a-a7de-4c39-8a7e-9fc88572f072,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97277a3a-a7') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_vif [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:32:13,bridge_name='br-int',has_traffic_filtering=True,id=97277a3a-a7de-4c39-8a7e-9fc88572f072,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97277a3a-a7') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97277a3a-a7, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:56:01 user nova-compute[71711]: INFO os_vif [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:32:13,bridge_name='br-int',has_traffic_filtering=True,id=97277a3a-a7de-4c39-8a7e-9fc88572f072,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97277a3a-a7')
Apr 12 06:56:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'venidAmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:56:01 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ec2513-c4ca-4f07-a772-289cfee83976]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:56:01 user nova-compute[71711]: No targets found.
Apr 12 06:56:01 user nova-compute[71711]: iSNS:
Apr 12 06:56:01 user nova-compute[71711]: No targets found.
Apr 12 06:56:01 user nova-compute[71711]: STATIC:
Apr 12 06:56:01 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad
Apr 12 06:56:01 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:56:01 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:56:01 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3
Apr 12 06:56:01 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:56:01 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:56:01 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704
Apr 12 06:56:01 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:56:01 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:56:01 user nova-compute[71711]: FIRMWARE:
Apr 12 06:56:01 user nova-compute[71711]: No targets found.
Apr 12 06:56:01 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:56:01 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:56:01 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3c4202-b138-40b5-a40e-a613736844ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[46acf0fe-d96c-4535-a69d-1fec915ef719]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:56:01 user nova-compute[71711]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad (non-flash)
Apr 12 06:56:01 user nova-compute[71711]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 (non-flash)
Apr 12 06:56:01 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:56:01 user nova-compute[71711]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad (non-flash)
Apr 12 06:56:01 user nova-compute[71711]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 (non-flash)
Apr 12 06:56:01 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c4d1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad'): ({'sdc'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Removing single pathed devices sdc {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6f3d5e-6492-488c-8fe1-3449958cc072]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5a2da7-3b24-4a0b-b777-aff85ba815cd]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flushing IO for device /dev/sdc {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b908f079-9959-48ad-8ed7-6d81ac01a204]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-f5faa478-9134-493b-bcb7-28ed8781a7cd tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "3666a910-9199-4582-8eb7-7b3b6263a535" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 4.820s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG nova.network.neutron [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updated VIF entry in instance network info cache for port 195ab8fb-eb21-4623-806e-6f8ff7a6f2ea. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG nova.network.neutron [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updating instance_info_cache with network_info: [{"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bda6b02-62e5-4f23-8bc3-a7c60d9c061a]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26432633663383766', '/dev/disk/by-id/scsi-1SCST_BIO7964eedb-d2c6c87f9927f251', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7964eedb') {{(pid=81777) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4c114d-d9b9-4ca4-8236-502ffbd470a1]: (4, None) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-c16b9692-0f04-4071-8b2e-0d64c0d09780 req-b7452d33-1b4e-4ce7-b6e0-ff3f56b216cf service nova] Releasing lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[79356a80-7116-4e3c-b9b4-a78c3b87c6dd]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcacca7-a49e-4e0a-a4fd-0251bc2a0d0c]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad, portal: 172.16.0.220,3260]
Apr 12 06:56:01 user nova-compute[71711]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad, portal: 172.16.0.220,3260] successful.
Apr 12 06:56:01 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9659873a-a3f8-4402-ac09-ffa6dee6c8ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[5974c7d7-57f3-4aae-b80f-6d2b8c92ecf1]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== disconnect_volume: return (339ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:56:01 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Deleting instance files /opt/stack/data/nova/instances/d338017f-0ae6-42dd-8015-68522ff99de8_del
Apr 12 06:56:01 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Deletion of /opt/stack/data/nova/instances/d338017f-0ae6-42dd-8015-68522ff99de8_del complete
Apr 12 06:56:01 user nova-compute[71711]: INFO nova.compute.manager [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 12 06:56:01 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:56:01 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:56:02 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:56:02 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Took 0.43 seconds to deallocate network for instance.
Apr 12 06:56:02 user nova-compute[71711]: INFO nova.compute.manager [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Took 0.76 seconds to detach 1 volumes for instance.
Apr 12 06:56:02 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Deleting volume: 9659873a-a3f8-4402-ac09-ffa6dee6c8ad {{(pid=71711) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 06:56:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:56:02 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:56:03 user nova-compute[71711]: DEBUG nova.compute.manager [req-4029f1db-1512-4384-b43e-b00cae4279d2 req-f712f81f-34b1-4dbb-a12f-71314b1e1290 service nova] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Received event network-vif-deleted-97277a3a-a7de-4c39-8a7e-9fc88572f072 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:56:03 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:56:03 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:56:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:03 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Deleted allocations for instance d338017f-0ae6-42dd-8015-68522ff99de8
Apr 12 06:56:03 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d26aba5e-a0ea-411e-b67d-af1be02c70d0 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "d338017f-0ae6-42dd-8015-68522ff99de8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.819s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:56:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:07 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:56:08 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:56:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:11 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:56:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:56:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 12 06:56:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 06:56:11 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:56:11 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:56:11 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:56:12 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681282557.1758206, 3666a910-9199-4582-8eb7-7b3b6263a535 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:56:12 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] VM Stopped (Lifecycle Event)
Apr 12 06:56:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-9561d5e8-33ef-40d0-b5b7-b27adcbb400f None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:56:14 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:56:14 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:56:14 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8584MB free_disk=26.070056915283203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:56:14 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:56:15 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:56:15 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:56:15 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:56:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:16 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681282561.1792505, d338017f-0ae6-42dd-8015-68522ff99de8 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:56:16 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] VM Stopped (Lifecycle Event)
Apr 12 06:56:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-35b93702-8036-43d9-8d89-6cd17bc34187 None None] [instance: d338017f-0ae6-42dd-8015-68522ff99de8] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:56:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:56:17 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:56:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:21 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:25 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:56:26 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:31 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:56:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:56:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:56:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:56:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:56:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:56:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:56:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:56:46 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:51 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:53 user nova-compute[71711]: INFO nova.compute.manager [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Terminating instance
Apr 12 06:56:53 user nova-compute[71711]: DEBUG nova.compute.manager [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-a38190c6-d4ff-480d-bd05-f62d85f62060 req-a4475167-61d2-4437-a35f-311dc6b5efb4 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Received event network-vif-unplugged-3d92724c-b271-4ead-a1b5-821d82d0ec85 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a38190c6-d4ff-480d-bd05-f62d85f62060 req-a4475167-61d2-4437-a35f-311dc6b5efb4 service nova] Acquiring lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a38190c6-d4ff-480d-bd05-f62d85f62060 req-a4475167-61d2-4437-a35f-311dc6b5efb4 service nova] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a38190c6-d4ff-480d-bd05-f62d85f62060 req-a4475167-61d2-4437-a35f-311dc6b5efb4 service nova] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-a38190c6-d4ff-480d-bd05-f62d85f62060 req-a4475167-61d2-4437-a35f-311dc6b5efb4 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] No waiting events found dispatching network-vif-unplugged-3d92724c-b271-4ead-a1b5-821d82d0ec85 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG nova.compute.manager [req-a38190c6-d4ff-480d-bd05-f62d85f62060 req-a4475167-61d2-4437-a35f-311dc6b5efb4 service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Received event network-vif-unplugged-3d92724c-b271-4ead-a1b5-821d82d0ec85 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:53 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Instance destroyed successfully.
Apr 12 06:56:53 user nova-compute[71711]: DEBUG nova.objects.instance [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lazy-loading 'resources' on Instance uuid e13297b8-5f8a-46e8-8793-a092b5b4fc9e {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1017592903',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1017592903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1017592903',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:52:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-mqcpf9xt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:52:28Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=e13297b8-5f8a-46e8-8793-a092b5b4fc9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "address": "fa:16:3e:4f:38:76", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d92724c-b2", "ovs_interfaceid": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "address": "fa:16:3e:4f:38:76", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d92724c-b2", "ovs_interfaceid": "3d92724c-b271-4ead-a1b5-821d82d0ec85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:38:76,bridge_name='br-int',has_traffic_filtering=True,id=3d92724c-b271-4ead-a1b5-821d82d0ec85,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d92724c-b2') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG os_vif [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:38:76,bridge_name='br-int',has_traffic_filtering=True,id=3d92724c-b271-4ead-a1b5-821d82d0ec85,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d92724c-b2') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d92724c-b2, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:56:53 user nova-compute[71711]: INFO os_vif [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:38:76,bridge_name='br-int',has_traffic_filtering=True,id=3d92724c-b271-4ead-a1b5-821d82d0ec85,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d92724c-b2')
Apr 12 06:56:53 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvwNblrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:56:53 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:56:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5d5c60-24a0-48b7-8df2-3ac878ee108a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:56:53 user nova-compute[71711]: No targets found.
Apr 12 06:56:53 user nova-compute[71711]: iSNS:
Apr 12 06:56:53 user nova-compute[71711]: No targets found.
Apr 12 06:56:53 user nova-compute[71711]: STATIC:
Apr 12 06:56:53 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3
Apr 12 06:56:53 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:56:53 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:56:53 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704
Apr 12 06:56:53 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:56:53 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:56:53 user nova-compute[71711]: FIRMWARE:
Apr 12 06:56:53 user nova-compute[71711]: No targets found.
Apr 12 06:56:53 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:56:53 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:56:53 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ff2319-c62f-41d6-9a01-269432398f62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f2b27f-3381-4094-81d3-7f4e9ff86d26]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:56:53 user nova-compute[71711]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 (non-flash)
Apr 12 06:56:53 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 (non-flash)
Apr 12 06:56:53 user nova-compute[71711]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 (non-flash)
Apr 12 06:56:53 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c36a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3'): ({'sdb'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Removing single pathed devices sdb {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4b7481-4acd-42a7-af47-5719a83e8ef4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b51cdbd-1ba9-41fb-a4d8-1a39a1b0a347]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flushing IO for device /dev/sdb {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37fb041-6dac-4c92-91d4-035b7ac0e917]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:56:53 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a45cd18-cf96-4c00-943e-ff3c93306f0c]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[236a184f-e4b2-4b4d-8e91-18a52df8705e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdadb807-1241-40e4-9d29-59e777e206ab]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3, portal: 172.16.0.220,3260]
Apr 12 06:56:54 user nova-compute[71711]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3, portal: 172.16.0.220,3260] successful.
Apr 12 06:56:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94a19e9-963c-4e8e-a613-6fc05da1dce3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac53b2f-7cf5-4650-a108-f66dd90b77be]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== disconnect_volume: return (306ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:56:54 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Deleting instance files /opt/stack/data/nova/instances/e13297b8-5f8a-46e8-8793-a092b5b4fc9e_del
Apr 12 06:56:54 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Deletion of /opt/stack/data/nova/instances/e13297b8-5f8a-46e8-8793-a092b5b4fc9e_del complete
Apr 12 06:56:54 user nova-compute[71711]: INFO nova.compute.manager [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 12 06:56:54 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:54 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:56:54 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Took 0.76 seconds to deallocate network for instance.
Apr 12 06:56:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Received event network-vif-plugged-3d92724c-b271-4ead-a1b5-821d82d0ec85 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:56:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] Acquiring lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:56:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:56:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] No waiting events found dispatching network-vif-plugged-3d92724c-b271-4ead-a1b5-821d82d0ec85 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:56:55 user nova-compute[71711]: WARNING nova.compute.manager [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Received unexpected event network-vif-plugged-3d92724c-b271-4ead-a1b5-821d82d0ec85 for instance with vm_state active and task_state deleting.
Apr 12 06:56:55 user nova-compute[71711]: DEBUG nova.compute.manager [req-8cd6f587-6bde-405f-b3cb-03327a521e7d req-753e1a56-80b2-4f5a-b7df-67f64c3350dc service nova] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Received event network-vif-deleted-3d92724c-b271-4ead-a1b5-821d82d0ec85 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:56:55 user nova-compute[71711]: INFO nova.compute.manager [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Took 0.77 seconds to detach 1 volumes for instance.
Apr 12 06:56:55 user nova-compute[71711]: DEBUG nova.compute.manager [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Deleting volume: c94a19e9-963c-4e8e-a613-6fc05da1dce3 {{(pid=71711) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 06:56:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:56:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:56:55 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:56:55 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:56:55 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:56 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Deleted allocations for instance e13297b8-5f8a-46e8-8793-a092b5b4fc9e
Apr 12 06:56:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-46e62d48-0e50-4290-b69e-64719efe88e4 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "e13297b8-5f8a-46e8-8793-a092b5b4fc9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.063s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:56:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:56:59 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:57:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:57:06 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:57:08 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:57:08 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681282613.7763627, e13297b8-5f8a-46e8-8793-a092b5b4fc9e => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:57:08 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] VM Stopped (Lifecycle Event)
Apr 12 06:57:08 user nova-compute[71711]: DEBUG nova.compute.manager [None req-3d92e3e1-bbd7-4540-9e39-729ca501c021 None None] [instance: e13297b8-5f8a-46e8-8793-a092b5b4fc9e] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:57:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:57:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:57:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:57:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:57:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:09 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:57:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:57:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:57:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:57:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:57:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:57:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:57:12 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:57:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updating instance_info_cache with network_info: [{"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:57:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:57:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:57:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:57:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:57:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:57:14 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:57:15 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:57:15 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:57:15 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=26.069168090820312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:57:15 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:57:16 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:57:16 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:57:16 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:57:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:19 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:57:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-changed-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:57:20 user nova-compute[71711]: DEBUG nova.compute.manager [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Refreshing instance network info cache due to event network-changed-b99eaecc-c588-46cb-84bf-10c63272eebf. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:57:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] Acquiring lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:57:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] Acquired lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:57:20 user nova-compute[71711]: DEBUG nova.network.neutron [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Refreshing network info cache for port b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:57:21 user nova-compute[71711]: DEBUG nova.network.neutron [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updated VIF entry in instance network info cache for port b99eaecc-c588-46cb-84bf-10c63272eebf. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:57:21 user nova-compute[71711]: DEBUG nova.network.neutron [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updating instance_info_cache with network_info: [{"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:57:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-34604d1c-f201-47c3-adb4-08e336a8e6d6 req-478e1d12-effe-4e57-8c22-f0ddfb1c731e service nova] Releasing lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:57:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-changed-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:57:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Refreshing instance network info cache due to event network-changed-b99eaecc-c588-46cb-84bf-10c63272eebf. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:57:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] Acquiring lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:57:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] Acquired lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:57:21 user nova-compute[71711]: DEBUG nova.network.neutron [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Refreshing network info cache for port b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:57:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:21 user nova-compute[71711]: INFO nova.compute.manager [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Detaching volume 98d566ec-564b-4062-9a9a-09066ee60704
Apr 12 06:57:22 user nova-compute[71711]: INFO nova.virt.block_device [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Attempting to driver detach volume 98d566ec-564b-4062-9a9a-09066ee60704 from mountpoint /dev/vdb
Apr 12 06:57:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Attempting to detach device vdb from instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 from the persistent domain config. {{(pid=71711) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:57:22 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:57:22 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:57:22 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:57:22 user nova-compute[71711]:   <serial>98d566ec-564b-4062-9a9a-09066ee60704</serial>
Apr 12 06:57:22 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:57:22 user nova-compute[71711]: </disk>
Apr 12 06:57:22 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG nova.network.neutron [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updated VIF entry in instance network info cache for port b99eaecc-c588-46cb-84bf-10c63272eebf. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG nova.network.neutron [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updating instance_info_cache with network_info: [{"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:57:22 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Successfully detached device vdb from instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 from the persistent domain config.
Apr 12 06:57:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 from the live domain config. {{(pid=71711) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.guest [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 06:57:22 user nova-compute[71711]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:57:22 user nova-compute[71711]:   <source dev="/dev/sdd"/>
Apr 12 06:57:22 user nova-compute[71711]:   <target dev="vdb" bus="virtio"/>
Apr 12 06:57:22 user nova-compute[71711]:   <serial>98d566ec-564b-4062-9a9a-09066ee60704</serial>
Apr 12 06:57:22 user nova-compute[71711]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 06:57:22 user nova-compute[71711]: </disk>
Apr 12 06:57:22 user nova-compute[71711]:  {{(pid=71711) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a672af58-6d80-4f7d-977c-eb4a04bed27c req-8971f6f9-0e7d-4e61-ad8d-201afc08e2c0 service nova] Releasing lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Received event <DeviceRemovedEvent: 1681282642.5397968, 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71711) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 {{(pid=71711) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 06:57:22 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Successfully detached device vdb from instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 from the live domain config.
Apr 12 06:57:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRuFkeig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:57:22 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b51f28-2792-45ca-bc33-1d64f99f4f2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:57:22 user nova-compute[71711]: No targets found.
Apr 12 06:57:22 user nova-compute[71711]: iSNS:
Apr 12 06:57:22 user nova-compute[71711]: No targets found.
Apr 12 06:57:22 user nova-compute[71711]: STATIC:
Apr 12 06:57:22 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704
Apr 12 06:57:22 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:57:22 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:57:22 user nova-compute[71711]: FIRMWARE:
Apr 12 06:57:22 user nova-compute[71711]: No targets found.
Apr 12 06:57:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:57:22 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:57:22 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbdb44a-eb95-4718-9bb9-7525d5b5f2f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[18020466-513c-4801-9748-6633d44405a2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 (non-flash)
Apr 12 06:57:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 (non-flash)
Apr 12 06:57:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9954263880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704'): ({'sdd'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Removing single pathed devices sdd {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f6aacd-601e-48bf-91da-d269dbba58c6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[feedd20e-815d-4303-ac47-527d804af68b]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Flushing IO for device /dev/sdd {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9100f47c-9e15-4178-a409-e7a19b22195f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[075ceee2-bccd-47bc-b4a6-9d681a2fb467]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] SCSI volumes sdd have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[472b1988-f7f2-40e1-a7d5-96c3681e4f8e]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ed5eaf-7243-46f5-b645-437b47695691]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704, portal: 172.16.0.220,3260]
Apr 12 06:57:22 user nova-compute[71711]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704, portal: 172.16.0.220,3260] successful.
Apr 12 06:57:22 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98d566ec-564b-4062-9a9a-09066ee60704 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b659a4a4-4ed9-4cb9-bc7d-0f454b7fee8f]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] <== disconnect_volume: return (373ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:57:22 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:57:23 user nova-compute[71711]: DEBUG nova.objects.instance [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'flavor' on Instance uuid 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:57:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-c9a65da6-da5f-411d-a580-c022f649a5b4 tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.833s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:57:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:57:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:57:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:57:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Verify base images {{(pid=71711) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Image id f80d148a-a25f-4656-aa33-568629afd9ae yields fingerprint 8f190d50d399c7d38b0903c1053bb6315a232e79 {{(pid=71711) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 12 06:57:34 user nova-compute[71711]: INFO nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] image f80d148a-a25f-4656-aa33-568629afd9ae at (/opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79): checking
Apr 12 06:57:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] image f80d148a-a25f-4656-aa33-568629afd9ae at (/opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79): image is in use {{(pid=71711) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71711) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 is a valid instance name {{(pid=71711) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 has a disk file {{(pid=71711) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 is backed by 8f190d50d399c7d38b0903c1053bb6315a232e79 {{(pid=71711) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 12 06:57:34 user nova-compute[71711]: WARNING nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Unknown base file: /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83
Apr 12 06:57:34 user nova-compute[71711]: WARNING nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a
Apr 12 06:57:34 user nova-compute[71711]: WARNING nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071
Apr 12 06:57:34 user nova-compute[71711]: WARNING nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204
Apr 12 06:57:34 user nova-compute[71711]: WARNING nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Unknown base file: /opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2
Apr 12 06:57:34 user nova-compute[71711]: WARNING nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218
Apr 12 06:57:34 user nova-compute[71711]: WARNING nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118
Apr 12 06:57:34 user nova-compute[71711]: WARNING nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b
Apr 12 06:57:34 user nova-compute[71711]: INFO nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Active base files: /opt/stack/data/nova/instances/_base/8f190d50d399c7d38b0903c1053bb6315a232e79
Apr 12 06:57:34 user nova-compute[71711]: INFO nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Removable base files: /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071 /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204 /opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2 /opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218 /opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118 /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b
Apr 12 06:57:34 user nova-compute[71711]: INFO nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83
Apr 12 06:57:34 user nova-compute[71711]: INFO nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cef3c22c9889719523c9c6bb8c95560451adb22a
Apr 12 06:57:34 user nova-compute[71711]: INFO nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4e48b19575c3c0adca8facff711d4fcda1b71071
Apr 12 06:57:34 user nova-compute[71711]: INFO nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a1eaee5a671e4b82224a24b868e3760511426204
Apr 12 06:57:34 user nova-compute[71711]: INFO nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/076518fa4f3bdf91a5f46cbdc7c88d4dedd5cef2
Apr 12 06:57:34 user nova-compute[71711]: INFO nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9878d41a27876d5767eebf67d331e3d033b27218
Apr 12 06:57:34 user nova-compute[71711]: INFO nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dfef1d88e4ef365d8235901be71f69a220720118
Apr 12 06:57:34 user nova-compute[71711]: INFO nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ab9fb5e71147c3fe979a27f9b0fcd481e1d19f1b
Apr 12 06:57:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Verification complete {{(pid=71711) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Verify swap images {{(pid=71711) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 12 06:57:34 user nova-compute[71711]: DEBUG nova.virt.libvirt.imagecache [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Verify ephemeral images {{(pid=71711) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 12 06:57:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:57:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "3666a910-9199-4582-8eb7-7b3b6263a535" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:48 user nova-compute[71711]: INFO nova.compute.manager [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Unshelving
Apr 12 06:57:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:48 user nova-compute[71711]: DEBUG nova.objects.instance [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'pci_requests' on Instance uuid 3666a910-9199-4582-8eb7-7b3b6263a535 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:57:48 user nova-compute[71711]: DEBUG nova.objects.instance [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'numa_topology' on Instance uuid 3666a910-9199-4582-8eb7-7b3b6263a535 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:57:48 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:57:48 user nova-compute[71711]: INFO nova.compute.claims [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Claim successful on node user
Apr 12 06:57:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:48 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:48 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 06:57:48 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.036s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 06:57:49 user nova-compute[71711]: INFO nova.compute.claims [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Claim successful on node user
Apr 12 06:57:49 user nova-compute[71711]: INFO nova.network.neutron [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updating port 195ab8fb-eb21-4623-806e-6f8ff7a6f2ea with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 06:57:49 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 06:57:49 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 06:57:49 user nova-compute[71711]: INFO nova.virt.block_device [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Booting with volume 1640bd09-1264-4e82-9e6e-0f1fa3cc654b at /dev/vda
Apr 12 06:57:49 user nova-compute[71711]: DEBUG nova.policy [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG os_brick.utils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8e1c0a-f2ab-4480-9be2-fae5ff083315]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e40b74-7840-4268-9461-c851a71850da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[092a2e28-681a-46d8-a06f-d3bdb240d985]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6872007-bee7-4d07-9d1d-c58d6678d577]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 06:57:49 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4379b87-9da0-4127-be38-bf11f114836e]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG os_brick.utils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Updating existing volume attachment record: 78754aa9-e953-494c-9f8c-ff85f76ed217 {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquired lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG nova.network.neutron [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-changed-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG nova.compute.manager [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Refreshing instance network info cache due to event network-changed-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:57:49 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] Acquiring lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:57:50 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Successfully created port: ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 06:57:50 user nova-compute[71711]: DEBUG nova.network.neutron [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updating instance_info_cache with network_info: [{"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:57:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Releasing lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:57:50 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:57:50 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Creating image(s)
Apr 12 06:57:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "/opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "/opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "/opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:50 user nova-compute[71711]: DEBUG nova.objects.instance [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3666a910-9199-4582-8eb7-7b3b6263a535 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:57:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] Acquired lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:57:50 user nova-compute[71711]: DEBUG nova.network.neutron [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Refreshing network info cache for port 195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:57:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "b1b7fc3a4dd7e65bce56500ffb909b398a73f860" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:50 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "b1b7fc3a4dd7e65bce56500ffb909b398a73f860" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860.part --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Successfully updated port: ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG nova.compute.manager [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Received event network-changed-ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG nova.compute.manager [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Refreshing instance network info cache due to event network-changed-ec21e1c6-11af-41ef-a200-42c0e932fec7. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] Acquiring lock "refresh_cache-f6641505-1353-4e5f-a8bb-935b9dc0c1be" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] Acquired lock "refresh_cache-f6641505-1353-4e5f-a8bb-935b9dc0c1be" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG nova.network.neutron [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Refreshing network info cache for port ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "refresh_cache-f6641505-1353-4e5f-a8bb-935b9dc0c1be" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG nova.network.neutron [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860.part --force-share --output=json" returned: 0 in 0.148s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG nova.virt.images [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] c8035aa5-0ef9-4a56-8190-706937c81a93 was qcow2, converting to raw {{(pid=71711) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG nova.privsep.utils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71711) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860.part /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860.converted {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG nova.network.neutron [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updated VIF entry in instance network info cache for port 195ab8fb-eb21-4623-806e-6f8ff7a6f2ea. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG nova.network.neutron [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updating instance_info_cache with network_info: [{"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-9bb71b15-d3e6-4f1c-be05-71f6239b3d84 req-f65f460a-ebc0-4fea-9adc-b7f51bc62ca3 service nova] Releasing lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860.part /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860.converted" returned: 0 in 0.387s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860.converted --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG nova.network.neutron [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "b1b7fc3a4dd7e65bce56500ffb909b398a73f860" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.470s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-2d45dd59-d769-4cd6-b135-8b58e83aff6a req-8a841054-2cd5-4146-bbe8-76b34938fc7a service nova] Releasing lock "refresh_cache-f6641505-1353-4e5f-a8bb-935b9dc0c1be" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquired lock "refresh_cache-f6641505-1353-4e5f-a8bb-935b9dc0c1be" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860 --force-share --output=json" returned: 0 in 0.139s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "b1b7fc3a4dd7e65bce56500ffb909b398a73f860" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "b1b7fc3a4dd7e65bce56500ffb909b398a73f860" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:51 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860 --force-share --output=json" returned: 0 in 0.134s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860,backing_fmt=raw /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk 1073741824 {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860,backing_fmt=raw /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk 1073741824" returned: 0 in 0.052s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "b1b7fc3a4dd7e65bce56500ffb909b398a73f860" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:52 user nova-compute[71711]: DEBUG nova.network.neutron [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Updating instance_info_cache with network_info: [{"id": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "address": "fa:16:3e:24:5e:c8", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec21e1c6-11", "ovs_interfaceid": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:57:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1b7fc3a4dd7e65bce56500ffb909b398a73f860 --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:52 user nova-compute[71711]: DEBUG nova.objects.instance [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'migration_context' on Instance uuid 3666a910-9199-4582-8eb7-7b3b6263a535 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:57:52 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Releasing lock "refresh_cache-f6641505-1353-4e5f-a8bb-935b9dc0c1be" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:57:52 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Instance network_info: |[{"id": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "address": "fa:16:3e:24:5e:c8", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec21e1c6-11", "ovs_interfaceid": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 06:57:52 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Rebasing disk image.
Apr 12 06:57:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 --force-share --output=json" returned: 0 in 0.131s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:52 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 -F raw /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 06:57:54 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Creating image(s)
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Ensure instance console log exists: /opt/stack/data/nova/instances/f6641505-1353-4e5f-a8bb-935b9dc0c1be/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Start _get_guest_xml network_info=[{"id": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "address": "fa:16:3e:24:5e:c8", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec21e1c6-11", "ovs_interfaceid": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRcotZzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f6641505-1353-4e5f-a8bb-935b9dc0c1be', 'attached_at': '', 'detached_at': '', 'volume_id': '1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'serial': '1640bd09-1264-4e82-9e6e-0f1fa3cc654b'}, 'attachment_id': '78754aa9-e953-494c-9f8c-ff85f76ed217', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:57:54 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:57:54 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRcotZzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:57:54 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:57:54 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:57:54 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2434a9ed-a59b-4c74-b118-d1dee27127ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 06:57:54 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fac37d7-e534-4374-893a-ea93c3408cf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b] added
Apr 12 06:57:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f05c919-4708-43cb-a2a4-b59d427d2565]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3b358f-1df4-45b4-ad3b-3119a358d8a8]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRcotZzs {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRcotZzs" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f4acdc-3390-42aa-a5df-c328427786d0]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hRcotZzs'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9aa02b2-ffc4-44da-b8ac-e7dd02e3ff79]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[deee9b34-f5b3-494f-a965-4fa7a9565987]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:57:54 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 06:57:54 user nova-compute[71711]:  {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:57:54 user nova-compute[71711]: WARNING os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 06:57:54 user nova-compute[71711]: 
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/22d6fa84953e1739938382b986a4a62193eceb83 -F raw /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk" returned: 0 in 1.949s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Created local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Ensure instance console log exists: /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Start _get_guest_xml network_info=[{"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='63ea1e3621e6b00cb4c57f83f1c5bb1c',container_format='bare',created_at=2023-04-12T06:55:57Z,direct_url=<?>,disk_format='qcow2',id=c8035aa5-0ef9-4a56-8190-706937c81a93,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1061983954-shelved',owner='76a8460ce5c24d1db20e80a1659133f7',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T06:56:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_options': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'image_id': '4f2549ed-915f-4494-87f3-9269834fa9da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 06:57:54 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:57:54 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='63ea1e3621e6b00cb4c57f83f1c5bb1c',container_format='bare',created_at=2023-04-12T06:55:57Z,direct_url=<?>,disk_format='qcow2',id=c8035aa5-0ef9-4a56-8190-706937c81a93,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1061983954-shelved',owner='76a8460ce5c24d1db20e80a1659133f7',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T06:56:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.objects.instance [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3666a910-9199-4582-8eb7-7b3b6263a535 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4777a77e-e754-4a02-899d-4acb5068e267]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260]
Apr 12 06:57:54 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260] successful.
Apr 12 06:57:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1061983954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1061983954',id=43,image_ref='c8035aa5-0ef9-4a56-8190-706937c81a93',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1503210292',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:54:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='76a8460ce5c24d1db20e80a1659133f7',ramdisk_id='',reservation_id='r-a0bmlrhx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1986658224',owner_user_name='tempest-AttachVolumeShelveTestJSON-1986658224-project-member',shelved_at='2023-04-12T06:55:59.786476',shelved_host='user',shelved_image_id='c8035aa5-0ef9-4a56-8190-706937c81a93'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fbb8c37e5a74a0b83011c2a21033204',uuid=3666a910-9199-4582-8eb7-7b3b6263a535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converting VIF {"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.objects.instance [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'pci_devices' on Instance uuid 3666a910-9199-4582-8eb7-7b3b6263a535 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1186ab-b2a7-4531-b9dd-a67144d54017]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:57:54 user nova-compute[71711]:   <uuid>3666a910-9199-4582-8eb7-7b3b6263a535</uuid>
Apr 12 06:57:54 user nova-compute[71711]:   <name>instance-0000002b</name>
Apr 12 06:57:54 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:57:54 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:57:54 user nova-compute[71711]:   <metadata>
Apr 12 06:57:54 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:57:54 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:57:54 user nova-compute[71711]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1061983954</nova:name>
Apr 12 06:57:54 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:57:54</nova:creationTime>
Apr 12 06:57:54 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:57:54 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:57:54 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:57:54 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:57:54 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:57:54 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:57:54 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:57:54 user nova-compute[71711]:       <nova:owner>
Apr 12 06:57:54 user nova-compute[71711]:         <nova:user uuid="4fbb8c37e5a74a0b83011c2a21033204">tempest-AttachVolumeShelveTestJSON-1986658224-project-member</nova:user>
Apr 12 06:57:54 user nova-compute[71711]:         <nova:project uuid="76a8460ce5c24d1db20e80a1659133f7">tempest-AttachVolumeShelveTestJSON-1986658224</nova:project>
Apr 12 06:57:54 user nova-compute[71711]:       </nova:owner>
Apr 12 06:57:54 user nova-compute[71711]:       <nova:root type="image" uuid="c8035aa5-0ef9-4a56-8190-706937c81a93"/>
Apr 12 06:57:54 user nova-compute[71711]:       <nova:ports>
Apr 12 06:57:54 user nova-compute[71711]:         <nova:port uuid="195ab8fb-eb21-4623-806e-6f8ff7a6f2ea">
Apr 12 06:57:54 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 06:57:54 user nova-compute[71711]:         </nova:port>
Apr 12 06:57:54 user nova-compute[71711]:       </nova:ports>
Apr 12 06:57:54 user nova-compute[71711]:     </nova:instance>
Apr 12 06:57:54 user nova-compute[71711]:   </metadata>
Apr 12 06:57:54 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:57:54 user nova-compute[71711]:     <system>
Apr 12 06:57:54 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:57:54 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:57:54 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:57:54 user nova-compute[71711]:       <entry name="serial">3666a910-9199-4582-8eb7-7b3b6263a535</entry>
Apr 12 06:57:54 user nova-compute[71711]:       <entry name="uuid">3666a910-9199-4582-8eb7-7b3b6263a535</entry>
Apr 12 06:57:54 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:57:54 user nova-compute[71711]:     </system>
Apr 12 06:57:54 user nova-compute[71711]:   </sysinfo>
Apr 12 06:57:54 user nova-compute[71711]:   <os>
Apr 12 06:57:54 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:57:54 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:57:54 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:57:54 user nova-compute[71711]:   </os>
Apr 12 06:57:54 user nova-compute[71711]:   <features>
Apr 12 06:57:54 user nova-compute[71711]:     <acpi/>
Apr 12 06:57:54 user nova-compute[71711]:     <apic/>
Apr 12 06:57:54 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:57:54 user nova-compute[71711]:   </features>
Apr 12 06:57:54 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:57:54 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:57:54 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:57:54 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:57:54 user nova-compute[71711]:   </clock>
Apr 12 06:57:54 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:57:54 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:57:54 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:57:54 user nova-compute[71711]:   </cpu>
Apr 12 06:57:54 user nova-compute[71711]:   <devices>
Apr 12 06:57:54 user nova-compute[71711]:     <disk type="file" device="disk">
Apr 12 06:57:54 user nova-compute[71711]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 06:57:54 user nova-compute[71711]:       <source file="/opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk"/>
Apr 12 06:57:54 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:57:54 user nova-compute[71711]:     </disk>
Apr 12 06:57:54 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:57:54 user nova-compute[71711]:       <mac address="fa:16:3e:87:f6:50"/>
Apr 12 06:57:54 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:57:54 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:57:54 user nova-compute[71711]:       <target dev="tap195ab8fb-eb"/>
Apr 12 06:57:54 user nova-compute[71711]:     </interface>
Apr 12 06:57:54 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:57:54 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/console.log" append="off"/>
Apr 12 06:57:54 user nova-compute[71711]:     </serial>
Apr 12 06:57:54 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:57:54 user nova-compute[71711]:     <video>
Apr 12 06:57:54 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:57:54 user nova-compute[71711]:     </video>
Apr 12 06:57:54 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:57:54 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:57:54 user nova-compute[71711]:     </rng>
Apr 12 06:57:54 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:57:54 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:57:54 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:57:54 user nova-compute[71711]:     </memballoon>
Apr 12 06:57:54 user nova-compute[71711]:   </devices>
Apr 12 06:57:54 user nova-compute[71711]: </domain>
Apr 12 06:57:54 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1061983954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1061983954',id=43,image_ref='c8035aa5-0ef9-4a56-8190-706937c81a93',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1503210292',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:54:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='76a8460ce5c24d1db20e80a1659133f7',ramdisk_id='',reservation_id='r-a0bmlrhx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1986658224',owner_user_name='tempest-AttachVolumeShelveTestJSON-1986658224-project-member',shelved_at='2023-04-12T06:55:59.786476',shelved_host='user',shelved_image_id='c8035aa5-0ef9-4a56-8190-706937c81a93'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fbb8c37e5a74a0b83011c2a21033204',uuid=3666a910-9199-4582-8eb7-7b3b6263a535,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converting VIF {"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_vif [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f1142b-e97c-4cb4-ace0-18b03527e118]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 06:57:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 06:57:54 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap195ab8fb-eb, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap195ab8fb-eb, col_values=(('external_ids', {'iface-id': '195ab8fb-eb21-4623-806e-6f8ff7a6f2ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:f6:50', 'vm-uuid': '3666a910-9199-4582-8eb7-7b3b6263a535'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:54 user nova-compute[71711]: INFO os_vif [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb')
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[752382ef-9e4f-4ca1-86d7-b89d81c4a3f6]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRcotZzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] No VIF found with MAC fa:16:3e:87:f6:50, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:57:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23431396461666561', 'path': '/dev/sdb'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431396461666561', 'path': '/dev/sdb'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-569607723',display_name='tempest-TestVolumeBootPattern-server-569607723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-569607723',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNbv/mQ5Jh7d3el2izrg+GDxn92QeO4zMIlTzLidAMtY3y/RJv3zDhTt+tusQuaHyr/g+rWCCyv+CQw77GLblNFXZcxdLxTAy4+wGytUE4zISxmCGpwWgUZaZVTfqOmhA==',key_name='tempest-TestVolumeBootPattern-1253801261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-o561a10n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:57:49Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=f6641505-1353-4e5f-a8bb-935b9dc0c1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "address": "fa:16:3e:24:5e:c8", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec21e1c6-11", "ovs_interfaceid": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "address": "fa:16:3e:24:5e:c8", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec21e1c6-11", "ovs_interfaceid": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:5e:c8,bridge_name='br-int',has_traffic_filtering=True,id=ec21e1c6-11af-41ef-a200-42c0e932fec7,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec21e1c6-11') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG nova.objects.instance [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lazy-loading 'pci_devices' on Instance uuid f6641505-1353-4e5f-a8bb-935b9dc0c1be {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] End _get_guest_xml xml=<domain type="kvm">
Apr 12 06:57:55 user nova-compute[71711]:   <uuid>f6641505-1353-4e5f-a8bb-935b9dc0c1be</uuid>
Apr 12 06:57:55 user nova-compute[71711]:   <name>instance-0000002d</name>
Apr 12 06:57:55 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 06:57:55 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 06:57:55 user nova-compute[71711]:   <metadata>
Apr 12 06:57:55 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 06:57:55 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 06:57:55 user nova-compute[71711]:       <nova:name>tempest-TestVolumeBootPattern-server-569607723</nova:name>
Apr 12 06:57:55 user nova-compute[71711]:       <nova:creationTime>2023-04-12 06:57:54</nova:creationTime>
Apr 12 06:57:55 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 06:57:55 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 06:57:55 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 06:57:55 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 06:57:55 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 06:57:55 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 06:57:55 user nova-compute[71711]:       </nova:flavor>
Apr 12 06:57:55 user nova-compute[71711]:       <nova:owner>
Apr 12 06:57:55 user nova-compute[71711]:         <nova:user uuid="1fec39f776464d339142eeed1ba95a6d">tempest-TestVolumeBootPattern-294210775-project-member</nova:user>
Apr 12 06:57:55 user nova-compute[71711]:         <nova:project uuid="13d1513e8b784c758412ddfc2692bb22">tempest-TestVolumeBootPattern-294210775</nova:project>
Apr 12 06:57:55 user nova-compute[71711]:       </nova:owner>
Apr 12 06:57:55 user nova-compute[71711]:       <nova:ports>
Apr 12 06:57:55 user nova-compute[71711]:         <nova:port uuid="ec21e1c6-11af-41ef-a200-42c0e932fec7">
Apr 12 06:57:55 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 06:57:55 user nova-compute[71711]:         </nova:port>
Apr 12 06:57:55 user nova-compute[71711]:       </nova:ports>
Apr 12 06:57:55 user nova-compute[71711]:     </nova:instance>
Apr 12 06:57:55 user nova-compute[71711]:   </metadata>
Apr 12 06:57:55 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 06:57:55 user nova-compute[71711]:     <system>
Apr 12 06:57:55 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 06:57:55 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 06:57:55 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 06:57:55 user nova-compute[71711]:       <entry name="serial">f6641505-1353-4e5f-a8bb-935b9dc0c1be</entry>
Apr 12 06:57:55 user nova-compute[71711]:       <entry name="uuid">f6641505-1353-4e5f-a8bb-935b9dc0c1be</entry>
Apr 12 06:57:55 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 06:57:55 user nova-compute[71711]:     </system>
Apr 12 06:57:55 user nova-compute[71711]:   </sysinfo>
Apr 12 06:57:55 user nova-compute[71711]:   <os>
Apr 12 06:57:55 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 06:57:55 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 06:57:55 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 06:57:55 user nova-compute[71711]:   </os>
Apr 12 06:57:55 user nova-compute[71711]:   <features>
Apr 12 06:57:55 user nova-compute[71711]:     <acpi/>
Apr 12 06:57:55 user nova-compute[71711]:     <apic/>
Apr 12 06:57:55 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 06:57:55 user nova-compute[71711]:   </features>
Apr 12 06:57:55 user nova-compute[71711]:   <clock offset="utc">
Apr 12 06:57:55 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 06:57:55 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 06:57:55 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 06:57:55 user nova-compute[71711]:   </clock>
Apr 12 06:57:55 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 06:57:55 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 06:57:55 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 06:57:55 user nova-compute[71711]:   </cpu>
Apr 12 06:57:55 user nova-compute[71711]:   <devices>
Apr 12 06:57:55 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 06:57:55 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 06:57:55 user nova-compute[71711]:       <source dev="/dev/sdb"/>
Apr 12 06:57:55 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 06:57:55 user nova-compute[71711]:       <serial>1640bd09-1264-4e82-9e6e-0f1fa3cc654b</serial>
Apr 12 06:57:55 user nova-compute[71711]:     </disk>
Apr 12 06:57:55 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 06:57:55 user nova-compute[71711]:       <mac address="fa:16:3e:24:5e:c8"/>
Apr 12 06:57:55 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:57:55 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 06:57:55 user nova-compute[71711]:       <target dev="tapec21e1c6-11"/>
Apr 12 06:57:55 user nova-compute[71711]:     </interface>
Apr 12 06:57:55 user nova-compute[71711]:     <serial type="pty">
Apr 12 06:57:55 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/f6641505-1353-4e5f-a8bb-935b9dc0c1be/console.log" append="off"/>
Apr 12 06:57:55 user nova-compute[71711]:     </serial>
Apr 12 06:57:55 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 06:57:55 user nova-compute[71711]:     <video>
Apr 12 06:57:55 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 06:57:55 user nova-compute[71711]:     </video>
Apr 12 06:57:55 user nova-compute[71711]:     <rng model="virtio">
Apr 12 06:57:55 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 06:57:55 user nova-compute[71711]:     </rng>
Apr 12 06:57:55 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 06:57:55 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 06:57:55 user nova-compute[71711]:       <stats period="10"/>
Apr 12 06:57:55 user nova-compute[71711]:     </memballoon>
Apr 12 06:57:55 user nova-compute[71711]:   </devices>
Apr 12 06:57:55 user nova-compute[71711]: </domain>
Apr 12 06:57:55 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-569607723',display_name='tempest-TestVolumeBootPattern-server-569607723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-569607723',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNbv/mQ5Jh7d3el2izrg+GDxn92QeO4zMIlTzLidAMtY3y/RJv3zDhTt+tusQuaHyr/g+rWCCyv+CQw77GLblNFXZcxdLxTAy4+wGytUE4zISxmCGpwWgUZaZVTfqOmhA==',key_name='tempest-TestVolumeBootPattern-1253801261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-o561a10n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T06:57:49Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=f6641505-1353-4e5f-a8bb-935b9dc0c1be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "address": "fa:16:3e:24:5e:c8", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec21e1c6-11", "ovs_interfaceid": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "address": "fa:16:3e:24:5e:c8", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec21e1c6-11", "ovs_interfaceid": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:5e:c8,bridge_name='br-int',has_traffic_filtering=True,id=ec21e1c6-11af-41ef-a200-42c0e932fec7,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec21e1c6-11') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG os_vif [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:5e:c8,bridge_name='br-int',has_traffic_filtering=True,id=ec21e1c6-11af-41ef-a200-42c0e932fec7,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec21e1c6-11') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec21e1c6-11, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec21e1c6-11, col_values=(('external_ids', {'iface-id': 'ec21e1c6-11af-41ef-a200-42c0e932fec7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:5e:c8', 'vm-uuid': 'f6641505-1353-4e5f-a8bb-935b9dc0c1be'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:55 user nova-compute[71711]: INFO os_vif [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:5e:c8,bridge_name='br-int',has_traffic_filtering=True,id=ec21e1c6-11af-41ef-a200-42c0e932fec7,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec21e1c6-11')
Apr 12 06:57:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] No VIF found with MAC fa:16:3e:24:5e:c8, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-003c11c6-3597-48f0-9ae3-f2c4cffe9b3f req-09e97e20-4ae2-4b1f-831f-191f62aad15b service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:57:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-003c11c6-3597-48f0-9ae3-f2c4cffe9b3f req-09e97e20-4ae2-4b1f-831f-191f62aad15b service nova] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-003c11c6-3597-48f0-9ae3-f2c4cffe9b3f req-09e97e20-4ae2-4b1f-831f-191f62aad15b service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:56 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-003c11c6-3597-48f0-9ae3-f2c4cffe9b3f req-09e97e20-4ae2-4b1f-831f-191f62aad15b service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:56 user nova-compute[71711]: DEBUG nova.compute.manager [req-003c11c6-3597-48f0-9ae3-f2c4cffe9b3f req-09e97e20-4ae2-4b1f-831f-191f62aad15b service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] No waiting events found dispatching network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:57:56 user nova-compute[71711]: WARNING nova.compute.manager [req-003c11c6-3597-48f0-9ae3-f2c4cffe9b3f req-09e97e20-4ae2-4b1f-831f-191f62aad15b service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received unexpected event network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 06:57:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:56 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:57:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] No waiting events found dispatching network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:57:58 user nova-compute[71711]: WARNING nova.compute.manager [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received unexpected event network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 06:57:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Received event network-vif-plugged-ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:57:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Acquiring lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] No waiting events found dispatching network-vif-plugged-ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:57:58 user nova-compute[71711]: WARNING nova.compute.manager [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Received unexpected event network-vif-plugged-ec21e1c6-11af-41ef-a200-42c0e932fec7 for instance with vm_state building and task_state spawning.
Apr 12 06:57:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Received event network-vif-plugged-ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:57:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Acquiring lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:57:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:57:58 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:58 user nova-compute[71711]: DEBUG nova.compute.manager [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] No waiting events found dispatching network-vif-plugged-ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:57:58 user nova-compute[71711]: WARNING nova.compute.manager [req-a5ec982b-a41e-4958-81a5-02bb39c2d78e req-71ca9587-d3da-4ad0-aff2-0170defb2bef service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Received unexpected event network-vif-plugged-ec21e1c6-11af-41ef-a200-42c0e932fec7 for instance with vm_state building and task_state spawning.
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282679.551279, 3666a910-9199-4582-8eb7-7b3b6263a535 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:57:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] VM Resumed (Lifecycle Event)
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:57:59 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Instance spawned successfully.
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:57:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282679.5527482, 3666a910-9199-4582-8eb7-7b3b6263a535 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:57:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] VM Started (Lifecycle Event)
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:57:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282679.6822553, f6641505-1353-4e5f-a8bb-935b9dc0c1be => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:57:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] VM Resumed (Lifecycle Event)
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 06:57:59 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Instance spawned successfully.
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 06:57:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282679.682384, f6641505-1353-4e5f-a8bb-935b9dc0c1be => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:57:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] VM Started (Lifecycle Event)
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:57:59 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 06:57:59 user nova-compute[71711]: INFO nova.compute.manager [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Took 5.75 seconds to spawn the instance on the hypervisor.
Apr 12 06:57:59 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:57:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-88ecdb68-3d31-4d67-991f-4c015f1f4360 tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "3666a910-9199-4582-8eb7-7b3b6263a535" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.226s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:57:59 user nova-compute[71711]: INFO nova.compute.manager [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Took 10.91 seconds to build instance.
Apr 12 06:57:59 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d5dead29-f4a6-477d-bfe4-79188b190b4b tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.007s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:58:00 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:58:07 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:09 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:09 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:58:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:58:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:58:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:58:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:58:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 06:58:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:58:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:58:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:58:12 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:58:12 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updating instance_info_cache with network_info: [{"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:58:12 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:58:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:58:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:58:13 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:58:14 user nova-compute[71711]: INFO nova.compute.manager [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Terminating instance
Apr 12 06:58:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf8e13ee-61d5-4d10-8aab-45fa91abb1b4 req-44dc7aa0-396d-4349-8bbb-7ab23c06b8b8 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-vif-unplugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf8e13ee-61d5-4d10-8aab-45fa91abb1b4 req-44dc7aa0-396d-4349-8bbb-7ab23c06b8b8 service nova] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf8e13ee-61d5-4d10-8aab-45fa91abb1b4 req-44dc7aa0-396d-4349-8bbb-7ab23c06b8b8 service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-bf8e13ee-61d5-4d10-8aab-45fa91abb1b4 req-44dc7aa0-396d-4349-8bbb-7ab23c06b8b8 service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf8e13ee-61d5-4d10-8aab-45fa91abb1b4 req-44dc7aa0-396d-4349-8bbb-7ab23c06b8b8 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] No waiting events found dispatching network-vif-unplugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:58:14 user nova-compute[71711]: DEBUG nova.compute.manager [req-bf8e13ee-61d5-4d10-8aab-45fa91abb1b4 req-44dc7aa0-396d-4349-8bbb-7ab23c06b8b8 service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-vif-unplugged-b99eaecc-c588-46cb-84bf-10c63272eebf for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:15 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Instance destroyed successfully.
Apr 12 06:58:15 user nova-compute[71711]: DEBUG nova.objects.instance [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lazy-loading 'resources' on Instance uuid 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:53:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1315008543',display_name='tempest-TestMinimumBasicScenario-server-1315008543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1315008543',id=42,image_ref='f80d148a-a25f-4656-aa33-568629afd9ae',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8omkAJ5QHXkbKVRiHFVG85cy80mBAbjxhQvXag1lrvEbH1vHi0AGYDPUpjAceyOw/UFX83aigQSWD29PXNlZ1i7g1u31wJY0pxuKqHAxdqoT9OXDVoKHd5rVyKkUvLww==',key_name='tempest-TestMinimumBasicScenario-709112217',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:53:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1aacffb9fbd4398b98db1f1945138dc',ramdisk_id='',reservation_id='r-3aq4zp3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f80d148a-a25f-4656-aa33-568629afd9ae',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1474504992',owner_user_name='tempest-TestMinimumBasicScenario-1474504992-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:55:37Z,user_data=None,user_id='2a188723ace3460792ed32d13bfe0d93',uuid=6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converting VIF {"id": "b99eaecc-c588-46cb-84bf-10c63272eebf", "address": "fa:16:3e:29:b6:18", "network": {"id": "e15834f3-3252-4493-9d01-4c068834b98e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1533216086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1aacffb9fbd4398b98db1f1945138dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99eaecc-c5", "ovs_interfaceid": "b99eaecc-c588-46cb-84bf-10c63272eebf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:b6:18,bridge_name='br-int',has_traffic_filtering=True,id=b99eaecc-c588-46cb-84bf-10c63272eebf,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99eaecc-c5') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG os_vif [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:b6:18,bridge_name='br-int',has_traffic_filtering=True,id=b99eaecc-c588-46cb-84bf-10c63272eebf,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99eaecc-c5') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb99eaecc-c5, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:58:15 user nova-compute[71711]: INFO os_vif [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:b6:18,bridge_name='br-int',has_traffic_filtering=True,id=b99eaecc-c588-46cb-84bf-10c63272eebf,network=Network(e15834f3-3252-4493-9d01-4c068834b98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99eaecc-c5')
Apr 12 06:58:15 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Deleting instance files /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4_del
Apr 12 06:58:15 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Deletion of /opt/stack/data/nova/instances/6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4_del complete
Apr 12 06:58:15 user nova-compute[71711]: INFO nova.compute.manager [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 12 06:58:15 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:58:16 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Took 0.78 seconds to deallocate network for instance.
Apr 12 06:58:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Refreshing inventories for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Updating ProviderTree inventory for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Updating inventory in ProviderTree for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 06:58:16 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:58:16 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:58:16 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8516MB free_disk=26.061084747314453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Refreshing aggregate associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, aggregates: None {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 06:58:16 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Refreshing trait associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, traits: HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] No waiting events found dispatching network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:58:17 user nova-compute[71711]: WARNING nova.compute.manager [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received unexpected event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf for instance with vm_state deleted and task_state None.
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] No waiting events found dispatching network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:58:17 user nova-compute[71711]: WARNING nova.compute.manager [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received unexpected event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf for instance with vm_state deleted and task_state None.
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] No waiting events found dispatching network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:58:17 user nova-compute[71711]: WARNING nova.compute.manager [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received unexpected event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf for instance with vm_state deleted and task_state None.
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Acquiring lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] No waiting events found dispatching network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:58:17 user nova-compute[71711]: WARNING nova.compute.manager [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received unexpected event network-vif-plugged-b99eaecc-c588-46cb-84bf-10c63272eebf for instance with vm_state deleted and task_state None.
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.manager [req-72dd388b-f981-4a9b-9d6f-431529b56d57 req-f7c5a65b-cdb2-4ed9-9627-1adf668c66da service nova] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Received event network-vif-deleted-b99eaecc-c588-46cb-84bf-10c63272eebf {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.675s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.202s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:58:17 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Deleted allocations for instance 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 3666a910-9199-4582-8eb7-7b3b6263a535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-9051e335-1c5b-4519-bf92-30372ba8667c tempest-TestMinimumBasicScenario-1474504992 tempest-TestMinimumBasicScenario-1474504992-project-member] Lock "6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.512s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:58:17 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:58:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:20 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:58:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:58:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:58:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:58:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:58:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:26 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:29 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:29 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71711) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 06:58:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:30 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681282695.4234974, 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:58:30 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] VM Stopped (Lifecycle Event)
Apr 12 06:58:30 user nova-compute[71711]: DEBUG nova.compute.manager [None req-980c9b73-35c0-4d08-963a-240de51f864a None None] [instance: 6e1d0ada-3959-43c9-bb4f-e3d7bb04e1f4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:58:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:34 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:58:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 06:58:34 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] There are 0 instances to clean {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 06:58:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:58:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:58:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:58:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:58:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:58:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:58:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:58:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:58:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:58:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:58:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:58:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:58:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:59:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:59:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:59:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:59:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:59:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:59:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:01 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:59:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:59:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:59:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:59:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:59:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:59:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:59:05 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid 3666a910-9199-4582-8eb7-7b3b6263a535 {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:59:05 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Triggering sync for uuid f6641505-1353-4e5f-a8bb-935b9dc0c1be {{(pid=71711) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 06:59:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "3666a910-9199-4582-8eb7-7b3b6263a535" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:05 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "3666a910-9199-4582-8eb7-7b3b6263a535" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:06 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:06 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:08 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:59:10 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:59:10 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:59:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:59:12 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 06:59:13 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:59:13 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 06:59:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:59:13 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:59:13 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 06:59:14 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updating instance_info_cache with network_info: [{"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:59:14 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-3666a910-9199-4582-8eb7-7b3b6263a535" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:59:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 06:59:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:59:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:59:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:59:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:59:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:59:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 06:59:18 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:59:18 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 06:59:18 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8626MB free_disk=26.08963394165039GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance 3666a910-9199-4582-8eb7-7b3b6263a535 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 06:59:18 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 06:59:19 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:59:19 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:59:19 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 06:59:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:59:22 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 06:59:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:59:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:59:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:59:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:59:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:59:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:59:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 06:59:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:59:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 06:59:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "3666a910-9199-4582-8eb7-7b3b6263a535" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:38 user nova-compute[71711]: INFO nova.compute.manager [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Terminating instance
Apr 12 06:59:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:59:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0867ec21-0217-41ed-9127-2d8ddaf908dc req-b9014371-70ed-46fc-88ac-c479829c0988 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-vif-unplugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0867ec21-0217-41ed-9127-2d8ddaf908dc req-b9014371-70ed-46fc-88ac-c479829c0988 service nova] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0867ec21-0217-41ed-9127-2d8ddaf908dc req-b9014371-70ed-46fc-88ac-c479829c0988 service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0867ec21-0217-41ed-9127-2d8ddaf908dc req-b9014371-70ed-46fc-88ac-c479829c0988 service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0867ec21-0217-41ed-9127-2d8ddaf908dc req-b9014371-70ed-46fc-88ac-c479829c0988 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] No waiting events found dispatching network-vif-unplugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0867ec21-0217-41ed-9127-2d8ddaf908dc req-b9014371-70ed-46fc-88ac-c479829c0988 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-vif-unplugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:59:39 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Instance destroyed successfully.
Apr 12 06:59:39 user nova-compute[71711]: DEBUG nova.objects.instance [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lazy-loading 'resources' on Instance uuid 3666a910-9199-4582-8eb7-7b3b6263a535 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T06:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1061983954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1061983954',id=43,image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZatAJqhPRKbsg3G5XFC/JkrKoFRPA+0R2UIBKzFMOJlUFJ6rJIELVTlaoiATccS59Gqp4lgra8q75tm0fDyDA6b//ESxqIoXD4S2MxQGGB56gMpEm5qcZHQfzxVjPWzQ==',key_name='tempest-keypair-1503210292',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:57:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76a8460ce5c24d1db20e80a1659133f7',ramdisk_id='',reservation_id='r-a0bmlrhx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f2549ed-915f-4494-87f3-9269834fa9da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1986658224',owner_user_name='tempest-AttachVolumeShelveTestJSON-1986658224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fbb8c37e5a74a0b83011c2a21033204',uuid=3666a910-9199-4582-8eb7-7b3b6263a535,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converting VIF {"id": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "address": "fa:16:3e:87:f6:50", "network": {"id": "f1744f20-6d53-4995-b638-1b500b3a999a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1090529466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a8460ce5c24d1db20e80a1659133f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap195ab8fb-eb", "ovs_interfaceid": "195ab8fb-eb21-4623-806e-6f8ff7a6f2ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG os_vif [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap195ab8fb-eb, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:59:39 user nova-compute[71711]: INFO os_vif [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:f6:50,bridge_name='br-int',has_traffic_filtering=True,id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea,network=Network(f1744f20-6d53-4995-b638-1b500b3a999a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap195ab8fb-eb')
Apr 12 06:59:39 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Deleting instance files /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535_del
Apr 12 06:59:39 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Deletion of /opt/stack/data/nova/instances/3666a910-9199-4582-8eb7-7b3b6263a535_del complete
Apr 12 06:59:39 user nova-compute[71711]: INFO nova.compute.manager [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 12 06:59:39 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:59:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:40 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:59:40 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Took 0.73 seconds to deallocate network for instance.
Apr 12 06:59:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-b842117e-59d6-4213-b632-231dd3fedf6a req-17369b82-819b-4ace-bf24-08db42fc1858 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-vif-deleted-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:59:40 user nova-compute[71711]: INFO nova.compute.manager [req-b842117e-59d6-4213-b632-231dd3fedf6a req-17369b82-819b-4ace-bf24-08db42fc1858 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Neutron deleted interface 195ab8fb-eb21-4623-806e-6f8ff7a6f2ea; detaching it from the instance and deleting it from the info cache
Apr 12 06:59:40 user nova-compute[71711]: DEBUG nova.network.neutron [req-b842117e-59d6-4213-b632-231dd3fedf6a req-17369b82-819b-4ace-bf24-08db42fc1858 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:59:40 user nova-compute[71711]: DEBUG nova.compute.manager [req-b842117e-59d6-4213-b632-231dd3fedf6a req-17369b82-819b-4ace-bf24-08db42fc1858 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Detach interface failed, port_id=195ab8fb-eb21-4623-806e-6f8ff7a6f2ea, reason: Instance 3666a910-9199-4582-8eb7-7b3b6263a535 could not be found. {{(pid=71711) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 06:59:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:40 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:59:40 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:59:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:40 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Deleted allocations for instance 3666a910-9199-4582-8eb7-7b3b6263a535
Apr 12 06:59:40 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-0a1fd7f2-4e86-440d-9c24-120fb5dd6b5e tempest-AttachVolumeShelveTestJSON-1986658224 tempest-AttachVolumeShelveTestJSON-1986658224-project-member] Lock "3666a910-9199-4582-8eb7-7b3b6263a535" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.915s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-07761ba5-abc4-4bff-9e35-34deb5951fcf req-0069f782-00dc-42d4-9c5d-773126076cd4 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received event network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:59:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-07761ba5-abc4-4bff-9e35-34deb5951fcf req-0069f782-00dc-42d4-9c5d-773126076cd4 service nova] Acquiring lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-07761ba5-abc4-4bff-9e35-34deb5951fcf req-0069f782-00dc-42d4-9c5d-773126076cd4 service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-07761ba5-abc4-4bff-9e35-34deb5951fcf req-0069f782-00dc-42d4-9c5d-773126076cd4 service nova] Lock "3666a910-9199-4582-8eb7-7b3b6263a535-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-07761ba5-abc4-4bff-9e35-34deb5951fcf req-0069f782-00dc-42d4-9c5d-773126076cd4 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] No waiting events found dispatching network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:59:41 user nova-compute[71711]: WARNING nova.compute.manager [req-07761ba5-abc4-4bff-9e35-34deb5951fcf req-0069f782-00dc-42d4-9c5d-773126076cd4 service nova] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Received unexpected event network-vif-plugged-195ab8fb-eb21-4623-806e-6f8ff7a6f2ea for instance with vm_state deleted and task_state None.
Apr 12 06:59:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:41 user nova-compute[71711]: INFO nova.compute.manager [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Terminating instance
Apr 12 06:59:41 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 06:59:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:42 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Instance destroyed successfully.
Apr 12 06:59:42 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lazy-loading 'resources' on Instance uuid f6641505-1353-4e5f-a8bb-935b9dc0c1be {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T06:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-569607723',display_name='tempest-TestVolumeBootPattern-server-569607723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-569607723',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNbv/mQ5Jh7d3el2izrg+GDxn92QeO4zMIlTzLidAMtY3y/RJv3zDhTt+tusQuaHyr/g+rWCCyv+CQw77GLblNFXZcxdLxTAy4+wGytUE4zISxmCGpwWgUZaZVTfqOmhA==',key_name='tempest-TestVolumeBootPattern-1253801261',keypairs=<?>,launch_index=0,launched_at=2023-04-12T06:57:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-o561a10n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T06:58:00Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=f6641505-1353-4e5f-a8bb-935b9dc0c1be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "address": "fa:16:3e:24:5e:c8", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec21e1c6-11", "ovs_interfaceid": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "address": "fa:16:3e:24:5e:c8", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec21e1c6-11", "ovs_interfaceid": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:5e:c8,bridge_name='br-int',has_traffic_filtering=True,id=ec21e1c6-11af-41ef-a200-42c0e932fec7,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec21e1c6-11') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_vif [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:5e:c8,bridge_name='br-int',has_traffic_filtering=True,id=ec21e1c6-11af-41ef-a200-42c0e932fec7,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec21e1c6-11') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec21e1c6-11, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 06:59:42 user nova-compute[71711]: INFO os_vif [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:5e:c8,bridge_name='br-int',has_traffic_filtering=True,id=ec21e1c6-11af-41ef-a200-42c0e932fec7,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec21e1c6-11')
Apr 12 06:59:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRcotZzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 06:59:42 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee7bf63-9c1b-45fd-b3fe-32879759db16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 06:59:42 user nova-compute[71711]: No targets found.
Apr 12 06:59:42 user nova-compute[71711]: iSNS:
Apr 12 06:59:42 user nova-compute[71711]: No targets found.
Apr 12 06:59:42 user nova-compute[71711]: STATIC:
Apr 12 06:59:42 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b
Apr 12 06:59:42 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 06:59:42 user nova-compute[71711]:                 Iface Name: default
Apr 12 06:59:42 user nova-compute[71711]: FIRMWARE:
Apr 12 06:59:42 user nova-compute[71711]: No targets found.
Apr 12 06:59:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 06:59:42 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 06:59:42 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc1630f-99ad-4f16-95ee-1a7fa25099a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[771f25e8-b53c-4626-9bb8-8c9a46e45cb7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 06:59:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 06:59:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f995c1b9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b'): ({'sdb'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Removing single pathed devices sdb {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4df1e26-8a4e-4469-8386-301ed0af1930]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f9da30-c424-42cc-b863-e3fc1898edfe]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flushing IO for device /dev/sdb {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22acf80-5a4e-49a3-aaf0-c4f1e3e1e05c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1e622d-48c0-4a01-84ed-357de04e8cf9]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b7e139-36ee-4ebe-8f20-22e27c47d288]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25c517d-230f-4c35-ae91-545d0feabe92]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260]
Apr 12 06:59:42 user nova-compute[71711]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260] successful.
Apr 12 06:59:42 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f021ef72-6838-48de-b59b-e934bdee468a]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== disconnect_volume: return (289ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 06:59:42 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Deleting instance files /opt/stack/data/nova/instances/f6641505-1353-4e5f-a8bb-935b9dc0c1be_del
Apr 12 06:59:42 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Deletion of /opt/stack/data/nova/instances/f6641505-1353-4e5f-a8bb-935b9dc0c1be_del complete
Apr 12 06:59:42 user nova-compute[71711]: INFO nova.compute.manager [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 12 06:59:42 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 06:59:42 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Received event network-changed-ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Refreshing instance network info cache due to event network-changed-ec21e1c6-11af-41ef-a200-42c0e932fec7. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Acquiring lock "refresh_cache-f6641505-1353-4e5f-a8bb-935b9dc0c1be" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Acquired lock "refresh_cache-f6641505-1353-4e5f-a8bb-935b9dc0c1be" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.network.neutron [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Refreshing network info cache for port ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:59:43 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Took 0.69 seconds to deallocate network for instance.
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-e864712e-8bbe-4664-bb3a-149a6ff8b4e9 req-58d15fd7-f3fb-4dad-8909-250e98b210fa service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Received event network-vif-deleted-ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:59:43 user nova-compute[71711]: INFO nova.compute.manager [req-e864712e-8bbe-4664-bb3a-149a6ff8b4e9 req-58d15fd7-f3fb-4dad-8909-250e98b210fa service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Neutron deleted interface ec21e1c6-11af-41ef-a200-42c0e932fec7; detaching it from the instance and deleting it from the info cache
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.network.neutron [req-e864712e-8bbe-4664-bb3a-149a6ff8b4e9 req-58d15fd7-f3fb-4dad-8909-250e98b210fa service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-e864712e-8bbe-4664-bb3a-149a6ff8b4e9 req-58d15fd7-f3fb-4dad-8909-250e98b210fa service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Detach interface failed, port_id=ec21e1c6-11af-41ef-a200-42c0e932fec7, reason: Instance f6641505-1353-4e5f-a8bb-935b9dc0c1be could not be found. {{(pid=71711) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.network.neutron [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Updated VIF entry in instance network info cache for port ec21e1c6-11af-41ef-a200-42c0e932fec7. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.network.neutron [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Updating instance_info_cache with network_info: [{"id": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "address": "fa:16:3e:24:5e:c8", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec21e1c6-11", "ovs_interfaceid": "ec21e1c6-11af-41ef-a200-42c0e932fec7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Releasing lock "refresh_cache-f6641505-1353-4e5f-a8bb-935b9dc0c1be" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Received event network-vif-unplugged-ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Acquiring lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] No waiting events found dispatching network-vif-unplugged-ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Received event network-vif-unplugged-ec21e1c6-11af-41ef-a200-42c0e932fec7 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Received event network-vif-plugged-ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Acquiring lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] No waiting events found dispatching network-vif-plugged-ec21e1c6-11af-41ef-a200-42c0e932fec7 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 06:59:43 user nova-compute[71711]: WARNING nova.compute.manager [req-32a1e1a9-454b-49d7-82a9-2a9bef823f59 req-52ee539e-fc40-42de-bade-27abf51f69ee service nova] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Received unexpected event network-vif-plugged-ec21e1c6-11af-41ef-a200-42c0e932fec7 for instance with vm_state active and task_state deleting.
Apr 12 06:59:44 user nova-compute[71711]: INFO nova.compute.manager [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Took 0.77 seconds to detach 1 volumes for instance.
Apr 12 06:59:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 06:59:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 06:59:44 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 06:59:44 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 06:59:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:44 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Deleted allocations for instance f6641505-1353-4e5f-a8bb-935b9dc0c1be
Apr 12 06:59:44 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7d5c7776-bbc4-4f2d-bbd0-49dacfa45f00 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "f6641505-1353-4e5f-a8bb-935b9dc0c1be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.964s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 06:59:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 06:59:54 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681282779.4929442, 3666a910-9199-4582-8eb7-7b3b6263a535 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:59:54 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] VM Stopped (Lifecycle Event)
Apr 12 06:59:54 user nova-compute[71711]: DEBUG nova.compute.manager [None req-6ddecf9e-f783-4214-a389-7c8df4109302 None None] [instance: 3666a910-9199-4582-8eb7-7b3b6263a535] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:59:57 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681282782.379594, f6641505-1353-4e5f-a8bb-935b9dc0c1be => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 06:59:57 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] VM Stopped (Lifecycle Event)
Apr 12 06:59:57 user nova-compute[71711]: DEBUG nova.compute.manager [None req-b0414473-4911-480d-a760-2c7f465526d3 None None] [instance: f6641505-1353-4e5f-a8bb-935b9dc0c1be] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 06:59:57 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:02 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:03 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:00:07 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:00:10 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:00:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:00:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:00:12 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:00:13 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:00:13 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:00:14 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:00:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:00:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 07:00:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:00:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:00:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:00:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:00:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:00:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:20 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:00:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:00:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:00:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:00:20 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:00:20 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:00:20 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:00:20 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8862MB free_disk=26.10818862915039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:00:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:00:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:00:20 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:00:20 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:00:20 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:00:20 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:00:20 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:00:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:00:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:00:23 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:00:27 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:00:28 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:00:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:32 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG nova.compute.manager [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:00:33 user nova-compute[71711]: INFO nova.compute.claims [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Claim successful on node user
Apr 12 07:00:33 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG nova.compute.manager [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG nova.compute.manager [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG nova.network.neutron [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:00:33 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:00:33 user nova-compute[71711]: DEBUG nova.compute.manager [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:00:33 user nova-compute[71711]: INFO nova.virt.block_device [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Booting with volume 1640bd09-1264-4e82-9e6e-0f1fa3cc654b at /dev/vda
Apr 12 07:00:33 user nova-compute[71711]: DEBUG nova.policy [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG os_brick.utils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f617ffb-0b68-49df-8e00-aa9e9dc5171c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7607a1-dc4d-4b5e-ab21-e085481d461e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[455da5ac-0721-4a1f-9110-6bc2e94b4135]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[06952def-e672-4fc0-ad1b-0edf141744ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:33 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:00:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:00:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:34 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:00:34 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:00:34 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eb401b-dd94-4e13-b889-7853240fba31]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:00:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:00:34 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:00:34 user nova-compute[71711]: DEBUG os_brick.utils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:00:34 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updating existing volume attachment record: 532d24d3-68c8-4980-9e73-f39c0a06011f {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:00:34 user nova-compute[71711]: DEBUG nova.network.neutron [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Successfully created port: db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:00:35 user nova-compute[71711]: DEBUG nova.network.neutron [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Successfully updated port: db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:00:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:00:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquired lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:00:35 user nova-compute[71711]: DEBUG nova.network.neutron [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:00:35 user nova-compute[71711]: DEBUG nova.network.neutron [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:00:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Received event network-changed-db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:00:35 user nova-compute[71711]: DEBUG nova.compute.manager [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Refreshing instance network info cache due to event network-changed-db6994d3-6239-4f48-b696-63d53248e164. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:00:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] Acquiring lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:00:35 user nova-compute[71711]: DEBUG nova.network.neutron [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updating instance_info_cache with network_info: [{"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:00:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Releasing lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:00:35 user nova-compute[71711]: DEBUG nova.compute.manager [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Instance network_info: |[{"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:00:35 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] Acquired lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:00:35 user nova-compute[71711]: DEBUG nova.network.neutron [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Refreshing network info cache for port db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:00:36 user nova-compute[71711]: DEBUG nova.network.neutron [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updated VIF entry in instance network info cache for port db6994d3-6239-4f48-b696-63d53248e164. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:00:36 user nova-compute[71711]: DEBUG nova.network.neutron [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updating instance_info_cache with network_info: [{"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:00:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-efce771d-68f0-47e5-a441-01752ab40648 req-caccff37-db57-43d1-93d7-c1950df41086 service nova] Releasing lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:00:36 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.compute.manager [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:00:38 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Creating image(s)
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Ensure instance console log exists: /opt/stack/data/nova/instances/e50420bc-12f0-40bd-82bc-d91f38fe3eaa/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Start _get_guest_xml network_info=[{"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRcotZzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e50420bc-12f0-40bd-82bc-d91f38fe3eaa', 'attached_at': '', 'detached_at': '', 'volume_id': '1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'serial': '1640bd09-1264-4e82-9e6e-0f1fa3cc654b'}, 'attachment_id': '532d24d3-68c8-4980-9e73-f39c0a06011f', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:00:38 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:00:38 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRcotZzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:00:38 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:00:38 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:00:38 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[08278cdb-b41a-4211-a221-d19051e2e1bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:00:38 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82a62fb-6ce4-4a62-9134-dfe541402c95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b] added
Apr 12 07:00:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1708743d-b883-437c-ab54-5df103c06f25]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f0425d-e314-44eb-a8be-6273b6ed9111]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRcotZzs {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hRcotZzs" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[50889fa5-1f53-4739-9938-1d2878c1c2a3]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hRcotZzs'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f61bf4-4eff-4f04-9001-68fead7d43df]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e70258-30ef-40cb-8994-caf3d07c7f25]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 07:00:38 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 07:00:38 user nova-compute[71711]:  {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:00:38 user nova-compute[71711]: WARNING os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 07:00:38 user nova-compute[71711]: 
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c0d691-3f9a-45ad-9d91-a70bfbfc5d51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260]
Apr 12 07:00:38 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260] successful.
Apr 12 07:00:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77eb6b6-2b58-4d64-84ea-589373636bbf]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7d0f05-ebf1-410a-bc83-5108d0002b09]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 07:00:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 07:00:38 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bef496-63a2-4906-846a-2e249cfc6ffe]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:00:38 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRcotZzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23431396461666561', 'path': '/dev/sdb'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431396461666561', 'path': '/dev/sdb'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1873720950',display_name='tempest-TestVolumeBootPattern-server-1873720950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1873720950',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNbv/mQ5Jh7d3el2izrg+GDxn92QeO4zMIlTzLidAMtY3y/RJv3zDhTt+tusQuaHyr/g+rWCCyv+CQw77GLblNFXZcxdLxTAy4+wGytUE4zISxmCGpwWgUZaZVTfqOmhA==',key_name='tempest-TestVolumeBootPattern-1253801261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-2sqtu976',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:00:34Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=e50420bc-12f0-40bd-82bc-d91f38fe3eaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:03:84,bridge_name='br-int',has_traffic_filtering=True,id=db6994d3-6239-4f48-b696-63d53248e164,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6994d3-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG nova.objects.instance [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lazy-loading 'pci_devices' on Instance uuid e50420bc-12f0-40bd-82bc-d91f38fe3eaa {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:00:39 user nova-compute[71711]:   <uuid>e50420bc-12f0-40bd-82bc-d91f38fe3eaa</uuid>
Apr 12 07:00:39 user nova-compute[71711]:   <name>instance-0000002e</name>
Apr 12 07:00:39 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 07:00:39 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 07:00:39 user nova-compute[71711]:   <metadata>
Apr 12 07:00:39 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:00:39 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 07:00:39 user nova-compute[71711]:       <nova:name>tempest-TestVolumeBootPattern-server-1873720950</nova:name>
Apr 12 07:00:39 user nova-compute[71711]:       <nova:creationTime>2023-04-12 07:00:38</nova:creationTime>
Apr 12 07:00:39 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 07:00:39 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 07:00:39 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 07:00:39 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 07:00:39 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:00:39 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:00:39 user nova-compute[71711]:       </nova:flavor>
Apr 12 07:00:39 user nova-compute[71711]:       <nova:owner>
Apr 12 07:00:39 user nova-compute[71711]:         <nova:user uuid="1fec39f776464d339142eeed1ba95a6d">tempest-TestVolumeBootPattern-294210775-project-member</nova:user>
Apr 12 07:00:39 user nova-compute[71711]:         <nova:project uuid="13d1513e8b784c758412ddfc2692bb22">tempest-TestVolumeBootPattern-294210775</nova:project>
Apr 12 07:00:39 user nova-compute[71711]:       </nova:owner>
Apr 12 07:00:39 user nova-compute[71711]:       <nova:ports>
Apr 12 07:00:39 user nova-compute[71711]:         <nova:port uuid="db6994d3-6239-4f48-b696-63d53248e164">
Apr 12 07:00:39 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 07:00:39 user nova-compute[71711]:         </nova:port>
Apr 12 07:00:39 user nova-compute[71711]:       </nova:ports>
Apr 12 07:00:39 user nova-compute[71711]:     </nova:instance>
Apr 12 07:00:39 user nova-compute[71711]:   </metadata>
Apr 12 07:00:39 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 07:00:39 user nova-compute[71711]:     <system>
Apr 12 07:00:39 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:00:39 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:00:39 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 07:00:39 user nova-compute[71711]:       <entry name="serial">e50420bc-12f0-40bd-82bc-d91f38fe3eaa</entry>
Apr 12 07:00:39 user nova-compute[71711]:       <entry name="uuid">e50420bc-12f0-40bd-82bc-d91f38fe3eaa</entry>
Apr 12 07:00:39 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:00:39 user nova-compute[71711]:     </system>
Apr 12 07:00:39 user nova-compute[71711]:   </sysinfo>
Apr 12 07:00:39 user nova-compute[71711]:   <os>
Apr 12 07:00:39 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:00:39 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 07:00:39 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 07:00:39 user nova-compute[71711]:   </os>
Apr 12 07:00:39 user nova-compute[71711]:   <features>
Apr 12 07:00:39 user nova-compute[71711]:     <acpi/>
Apr 12 07:00:39 user nova-compute[71711]:     <apic/>
Apr 12 07:00:39 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 07:00:39 user nova-compute[71711]:   </features>
Apr 12 07:00:39 user nova-compute[71711]:   <clock offset="utc">
Apr 12 07:00:39 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:00:39 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:00:39 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 07:00:39 user nova-compute[71711]:   </clock>
Apr 12 07:00:39 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 07:00:39 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 07:00:39 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:00:39 user nova-compute[71711]:   </cpu>
Apr 12 07:00:39 user nova-compute[71711]:   <devices>
Apr 12 07:00:39 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 07:00:39 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:00:39 user nova-compute[71711]:       <source dev="/dev/sdb"/>
Apr 12 07:00:39 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 07:00:39 user nova-compute[71711]:       <serial>1640bd09-1264-4e82-9e6e-0f1fa3cc654b</serial>
Apr 12 07:00:39 user nova-compute[71711]:     </disk>
Apr 12 07:00:39 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 07:00:39 user nova-compute[71711]:       <mac address="fa:16:3e:86:03:84"/>
Apr 12 07:00:39 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 07:00:39 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 07:00:39 user nova-compute[71711]:       <target dev="tapdb6994d3-62"/>
Apr 12 07:00:39 user nova-compute[71711]:     </interface>
Apr 12 07:00:39 user nova-compute[71711]:     <serial type="pty">
Apr 12 07:00:39 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/e50420bc-12f0-40bd-82bc-d91f38fe3eaa/console.log" append="off"/>
Apr 12 07:00:39 user nova-compute[71711]:     </serial>
Apr 12 07:00:39 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:00:39 user nova-compute[71711]:     <video>
Apr 12 07:00:39 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 07:00:39 user nova-compute[71711]:     </video>
Apr 12 07:00:39 user nova-compute[71711]:     <rng model="virtio">
Apr 12 07:00:39 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:00:39 user nova-compute[71711]:     </rng>
Apr 12 07:00:39 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:00:39 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 07:00:39 user nova-compute[71711]:       <stats period="10"/>
Apr 12 07:00:39 user nova-compute[71711]:     </memballoon>
Apr 12 07:00:39 user nova-compute[71711]:   </devices>
Apr 12 07:00:39 user nova-compute[71711]: </domain>
Apr 12 07:00:39 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1873720950',display_name='tempest-TestVolumeBootPattern-server-1873720950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1873720950',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNbv/mQ5Jh7d3el2izrg+GDxn92QeO4zMIlTzLidAMtY3y/RJv3zDhTt+tusQuaHyr/g+rWCCyv+CQw77GLblNFXZcxdLxTAy4+wGytUE4zISxmCGpwWgUZaZVTfqOmhA==',key_name='tempest-TestVolumeBootPattern-1253801261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-2sqtu976',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:00:34Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=e50420bc-12f0-40bd-82bc-d91f38fe3eaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:03:84,bridge_name='br-int',has_traffic_filtering=True,id=db6994d3-6239-4f48-b696-63d53248e164,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6994d3-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG os_vif [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:03:84,bridge_name='br-int',has_traffic_filtering=True,id=db6994d3-6239-4f48-b696-63d53248e164,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6994d3-62') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb6994d3-62, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb6994d3-62, col_values=(('external_ids', {'iface-id': 'db6994d3-6239-4f48-b696-63d53248e164', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:03:84', 'vm-uuid': 'e50420bc-12f0-40bd-82bc-d91f38fe3eaa'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:39 user nova-compute[71711]: INFO os_vif [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:03:84,bridge_name='br-int',has_traffic_filtering=True,id=db6994d3-6239-4f48-b696-63d53248e164,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6994d3-62')
Apr 12 07:00:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:00:39 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] No VIF found with MAC fa:16:3e:86:03:84, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:00:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-da5acdd2-cf34-41c0-b6e1-a35e944bca88 req-7ce1d6c6-66d7-4bf9-b501-3328ead1ec94 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Received event network-vif-plugged-db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:00:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-da5acdd2-cf34-41c0-b6e1-a35e944bca88 req-7ce1d6c6-66d7-4bf9-b501-3328ead1ec94 service nova] Acquiring lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:00:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-da5acdd2-cf34-41c0-b6e1-a35e944bca88 req-7ce1d6c6-66d7-4bf9-b501-3328ead1ec94 service nova] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:00:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-da5acdd2-cf34-41c0-b6e1-a35e944bca88 req-7ce1d6c6-66d7-4bf9-b501-3328ead1ec94 service nova] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:00:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-da5acdd2-cf34-41c0-b6e1-a35e944bca88 req-7ce1d6c6-66d7-4bf9-b501-3328ead1ec94 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] No waiting events found dispatching network-vif-plugged-db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:00:41 user nova-compute[71711]: WARNING nova.compute.manager [req-da5acdd2-cf34-41c0-b6e1-a35e944bca88 req-7ce1d6c6-66d7-4bf9-b501-3328ead1ec94 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Received unexpected event network-vif-plugged-db6994d3-6239-4f48-b696-63d53248e164 for instance with vm_state building and task_state spawning.
Apr 12 07:00:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:41 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282843.3336663, e50420bc-12f0-40bd-82bc-d91f38fe3eaa => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:00:43 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] VM Resumed (Lifecycle Event)
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:00:43 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Instance spawned successfully.
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:00:43 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282843.3353474, e50420bc-12f0-40bd-82bc-d91f38fe3eaa => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:00:43 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] VM Started (Lifecycle Event)
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:00:43 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:00:43 user nova-compute[71711]: INFO nova.compute.manager [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Took 4.94 seconds to spawn the instance on the hypervisor.
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.compute.manager [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:00:43 user nova-compute[71711]: INFO nova.compute.manager [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Took 10.10 seconds to build instance.
Apr 12 07:00:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-911f579a-b888-4075-9f63-8487597627da tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.188s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-0291fd6d-c35c-4fb6-b34f-da5c7c331959 req-625ae675-7d40-48e9-b6f4-f029c7d38f29 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Received event network-vif-plugged-db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0291fd6d-c35c-4fb6-b34f-da5c7c331959 req-625ae675-7d40-48e9-b6f4-f029c7d38f29 service nova] Acquiring lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0291fd6d-c35c-4fb6-b34f-da5c7c331959 req-625ae675-7d40-48e9-b6f4-f029c7d38f29 service nova] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0291fd6d-c35c-4fb6-b34f-da5c7c331959 req-625ae675-7d40-48e9-b6f4-f029c7d38f29 service nova] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:00:43 user nova-compute[71711]: DEBUG nova.compute.manager [req-0291fd6d-c35c-4fb6-b34f-da5c7c331959 req-625ae675-7d40-48e9-b6f4-f029c7d38f29 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] No waiting events found dispatching network-vif-plugged-db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:00:43 user nova-compute[71711]: WARNING nova.compute.manager [req-0291fd6d-c35c-4fb6-b34f-da5c7c331959 req-625ae675-7d40-48e9-b6f4-f029c7d38f29 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Received unexpected event network-vif-plugged-db6994d3-6239-4f48-b696-63d53248e164 for instance with vm_state active and task_state None.
Apr 12 07:00:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:00:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:04 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:01:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:01:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:01:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:01:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:01:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:10 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:01:13 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:01:14 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:01:14 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:01:14 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:01:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:01:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:01:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 07:01:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:01:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:01:16 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:01:16 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid e50420bc-12f0-40bd-82bc-d91f38fe3eaa {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:01:16 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updating instance_info_cache with network_info: [{"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:01:16 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:01:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:01:17 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:01:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:01:21 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:01:21 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:01:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8777MB free_disk=26.095783233642578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:01:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:01:24 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:01:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:01:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:01:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:01:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:01:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:01:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:01:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:01:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:01:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:01:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:01:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:01:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:01:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:01:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:01:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:01:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:01:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:01:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:01:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:01:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:01:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:01:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:01:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:01:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:01:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:05 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:02:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:02:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:02:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:02:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:02:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:02:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:11 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:02:14 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:02:14 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:02:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:02:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:02:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:02:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:02:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:02:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:02:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:02:18 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:02:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:02:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 07:02:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:02:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:02:18 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:02:18 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid e50420bc-12f0-40bd-82bc-d91f38fe3eaa {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:02:18 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updating instance_info_cache with network_info: [{"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:02:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:02:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:02:18 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:02:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:02:21 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:02:21 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:02:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8844MB free_disk=26.09478759765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:02:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:02:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Received event network-changed-db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:02:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Refreshing instance network info cache due to event network-changed-db6994d3-6239-4f48-b696-63d53248e164. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:02:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] Acquiring lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:02:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] Acquired lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:02:25 user nova-compute[71711]: DEBUG nova.network.neutron [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Refreshing network info cache for port db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:02:25 user nova-compute[71711]: DEBUG nova.network.neutron [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updated VIF entry in instance network info cache for port db6994d3-6239-4f48-b696-63d53248e164. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:02:25 user nova-compute[71711]: DEBUG nova.network.neutron [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updating instance_info_cache with network_info: [{"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:02:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0aed2308-786d-46ee-aa09-4ff0c150c22a req-7d990199-556c-4471-8631-797882337962 service nova] Releasing lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:02:25 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:02:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:02:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:02:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Starting instance... {{(pid=71711) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 07:02:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:02:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:02:31 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71711) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 07:02:31 user nova-compute[71711]: INFO nova.compute.claims [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Claim successful on node user
Apr 12 07:02:31 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:02:31 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:02:31 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:02:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Start building networks asynchronously for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 07:02:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Allocating IP information in the background. {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 07:02:31 user nova-compute[71711]: DEBUG nova.network.neutron [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] allocate_for_instance() {{(pid=71711) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 07:02:31 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 07:02:31 user nova-compute[71711]: DEBUG nova.compute.manager [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Start building block device mappings for instance. {{(pid=71711) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 07:02:31 user nova-compute[71711]: INFO nova.virt.block_device [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Booting with volume 6836b4d5-ab04-46f5-bd65-97daf28c5c63 at /dev/vda
Apr 12 07:02:31 user nova-compute[71711]: DEBUG os_brick.utils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:02:31 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca077b5b-20e3-4600-89d9-416675060afd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c92c7a219d5\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG nova.policy [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fec39f776464d339142eeed1ba95a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d1513e8b784c758412ddfc2692bb22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71711) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[795d5425-1fb2-4ac2-ad82-11327cef1c73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cfccab-43f9-419e-9129-f7dd81f18661]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3331fe-494c-4a92-89e9-c9db75b677cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Running cmd (subprocess): nvme version {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] 'nvme version' failed. Not Retrying. {{(pid=71711) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] nvme not present on system {{(pid=71711) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 07:02:32 user nova-compute[71711]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 07:02:32 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c11d748-428a-441a-8bf8-a956327bf104]: (4, '') {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71711) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.lightos [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] LIGHTOS: no hostnqn found. {{(pid=71711) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG os_brick.utils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c92c7a219d5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG nova.virt.block_device [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Updating existing volume attachment record: 140c0233-24f6-4c9a-b3cc-53829243decc {{(pid=71711) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 07:02:32 user nova-compute[71711]: DEBUG nova.network.neutron [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Successfully created port: 1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 07:02:33 user nova-compute[71711]: DEBUG nova.network.neutron [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Successfully updated port: 1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 07:02:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:02:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquired lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:02:33 user nova-compute[71711]: DEBUG nova.network.neutron [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Building network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 07:02:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Received event network-changed-1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:02:33 user nova-compute[71711]: DEBUG nova.compute.manager [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Refreshing instance network info cache due to event network-changed-1650e68d-e118-40ee-90dd-608846dcf213. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:02:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] Acquiring lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:02:33 user nova-compute[71711]: DEBUG nova.network.neutron [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Instance cache missing network info. {{(pid=71711) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 07:02:33 user nova-compute[71711]: DEBUG nova.network.neutron [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Updating instance_info_cache with network_info: [{"id": "1650e68d-e118-40ee-90dd-608846dcf213", "address": "fa:16:3e:90:7d:af", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1650e68d-e1", "ovs_interfaceid": "1650e68d-e118-40ee-90dd-608846dcf213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:02:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Releasing lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:02:33 user nova-compute[71711]: DEBUG nova.compute.manager [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Instance network_info: |[{"id": "1650e68d-e118-40ee-90dd-608846dcf213", "address": "fa:16:3e:90:7d:af", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1650e68d-e1", "ovs_interfaceid": "1650e68d-e118-40ee-90dd-608846dcf213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71711) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 07:02:33 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] Acquired lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:02:33 user nova-compute[71711]: DEBUG nova.network.neutron [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Refreshing network info cache for port 1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:02:34 user nova-compute[71711]: DEBUG nova.network.neutron [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Updated VIF entry in instance network info cache for port 1650e68d-e118-40ee-90dd-608846dcf213. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:02:34 user nova-compute[71711]: DEBUG nova.network.neutron [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Updating instance_info_cache with network_info: [{"id": "1650e68d-e118-40ee-90dd-608846dcf213", "address": "fa:16:3e:90:7d:af", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1650e68d-e1", "ovs_interfaceid": "1650e68d-e118-40ee-90dd-608846dcf213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:02:34 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-47dae55f-4f4b-4ee0-abc3-b8c760d363e6 req-67c83a0d-fdeb-444a-ae22-3ec21fb81fc2 service nova] Releasing lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:02:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Start spawning the instance on the hypervisor. {{(pid=71711) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Creating instance directory {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 07:02:36 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Creating image(s)
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Did not create local disks {{(pid=71711) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Ensure instance console log exists: /opt/stack/data/nova/instances/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4/console.log {{(pid=71711) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Start _get_guest_xml network_info=[{"id": "1650e68d-e118-40ee-90dd-608846dcf213", "address": "fa:16:3e:90:7d:af", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1650e68d-e1", "ovs_interfaceid": "1650e68d-e118-40ee-90dd-608846dcf213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRiAsNwu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4', 'attached_at': '', 'detached_at': '', 'volume_id': '6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'serial': '6836b4d5-ab04-46f5-bd65-97daf28c5c63'}, 'attachment_id': '140c0233-24f6-4c9a-b3cc-53829243decc', 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 07:02:36 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:02:36 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71711) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T06:19:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image limits 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flavor pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Image pref 0:0:0 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Got 1 possible topologies {{(pid=71711) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.hardware [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71711) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Calling os-brick to attach iSCSI Volume {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRiAsNwu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:02:36 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:02:36 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:02:36 user nova-compute[71711]: INFO os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[71923d3a-001a-4a60-a94f-a1f88e542c90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 07:02:36 user nova-compute[71711]:  {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --interface default --op new {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1edace-28e9-4e19-a498-80fb3ed48f90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63] added\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63] added
Apr 12 07:02:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.056s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1b6c31-71fc-4afc-942c-1e0efb817362]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[58651f43-a007-4968-8bbc-6ae9514355f0]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRiAsNwu {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRiAsNwu" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[31826946-05e1-4fff-a7c5-05eab4b30869]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZRiAsNwu'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c536c474-7bd4-4c38-a8eb-127506a25842]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0f96b7-593a-4960-81a1-6ad1ed110d7d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 07:02:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 07:02:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --login {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0a5f73-79fb-4a69-b865-c1b6c94aa6f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63, portal: 172.16.0.220,3260]
Apr 12 07:02:36 user nova-compute[71711]: Login to [iface: default, target: iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63, portal: 172.16.0.220,3260] successful.
Apr 12 07:02:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c8d4c1-842b-40fa-81f2-648a4613ae82]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0819da-d128-49cb-83fb-f26f50dc36cc]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 07:02:36 user nova-compute[71711]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 (non-flash)
Apr 12 07:02:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 07:02:36 user nova-compute[71711]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 (non-flash)
Apr 12 07:02:36 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Connected to 172.16.0.220:3260 {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=71711) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71711) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9db27b5-6203-44f7-88dd-8e496832a032]: (4, ('- - 0', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:02:36 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71711) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRiAsNwu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71711) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26430646463356133', 'path': '/dev/sdc'} {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430646463356133', 'path': '/dev/sdc'} {{(pid=71711) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-321254683',display_name='tempest-TestVolumeBootPattern-server-321254683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-321254683',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNbv/mQ5Jh7d3el2izrg+GDxn92QeO4zMIlTzLidAMtY3y/RJv3zDhTt+tusQuaHyr/g+rWCCyv+CQw77GLblNFXZcxdLxTAy4+wGytUE4zISxmCGpwWgUZaZVTfqOmhA==',key_name='tempest-TestVolumeBootPattern-1253801261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-h6hc4ls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:02:32Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1650e68d-e118-40ee-90dd-608846dcf213", "address": "fa:16:3e:90:7d:af", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1650e68d-e1", "ovs_interfaceid": "1650e68d-e118-40ee-90dd-608846dcf213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71711) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "1650e68d-e118-40ee-90dd-608846dcf213", "address": "fa:16:3e:90:7d:af", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1650e68d-e1", "ovs_interfaceid": "1650e68d-e118-40ee-90dd-608846dcf213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1650e68d-e118-40ee-90dd-608846dcf213,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1650e68d-e1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG nova.objects.instance [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lazy-loading 'pci_devices' on Instance uuid f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] End _get_guest_xml xml=<domain type="kvm">
Apr 12 07:02:37 user nova-compute[71711]:   <uuid>f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4</uuid>
Apr 12 07:02:37 user nova-compute[71711]:   <name>instance-0000002f</name>
Apr 12 07:02:37 user nova-compute[71711]:   <memory>131072</memory>
Apr 12 07:02:37 user nova-compute[71711]:   <vcpu>1</vcpu>
Apr 12 07:02:37 user nova-compute[71711]:   <metadata>
Apr 12 07:02:37 user nova-compute[71711]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 07:02:37 user nova-compute[71711]:       <nova:package version="0.0.0"/>
Apr 12 07:02:37 user nova-compute[71711]:       <nova:name>tempest-TestVolumeBootPattern-server-321254683</nova:name>
Apr 12 07:02:37 user nova-compute[71711]:       <nova:creationTime>2023-04-12 07:02:36</nova:creationTime>
Apr 12 07:02:37 user nova-compute[71711]:       <nova:flavor name="m1.nano">
Apr 12 07:02:37 user nova-compute[71711]:         <nova:memory>128</nova:memory>
Apr 12 07:02:37 user nova-compute[71711]:         <nova:disk>1</nova:disk>
Apr 12 07:02:37 user nova-compute[71711]:         <nova:swap>0</nova:swap>
Apr 12 07:02:37 user nova-compute[71711]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 07:02:37 user nova-compute[71711]:         <nova:vcpus>1</nova:vcpus>
Apr 12 07:02:37 user nova-compute[71711]:       </nova:flavor>
Apr 12 07:02:37 user nova-compute[71711]:       <nova:owner>
Apr 12 07:02:37 user nova-compute[71711]:         <nova:user uuid="1fec39f776464d339142eeed1ba95a6d">tempest-TestVolumeBootPattern-294210775-project-member</nova:user>
Apr 12 07:02:37 user nova-compute[71711]:         <nova:project uuid="13d1513e8b784c758412ddfc2692bb22">tempest-TestVolumeBootPattern-294210775</nova:project>
Apr 12 07:02:37 user nova-compute[71711]:       </nova:owner>
Apr 12 07:02:37 user nova-compute[71711]:       <nova:ports>
Apr 12 07:02:37 user nova-compute[71711]:         <nova:port uuid="1650e68d-e118-40ee-90dd-608846dcf213">
Apr 12 07:02:37 user nova-compute[71711]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 07:02:37 user nova-compute[71711]:         </nova:port>
Apr 12 07:02:37 user nova-compute[71711]:       </nova:ports>
Apr 12 07:02:37 user nova-compute[71711]:     </nova:instance>
Apr 12 07:02:37 user nova-compute[71711]:   </metadata>
Apr 12 07:02:37 user nova-compute[71711]:   <sysinfo type="smbios">
Apr 12 07:02:37 user nova-compute[71711]:     <system>
Apr 12 07:02:37 user nova-compute[71711]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 07:02:37 user nova-compute[71711]:       <entry name="product">OpenStack Nova</entry>
Apr 12 07:02:37 user nova-compute[71711]:       <entry name="version">0.0.0</entry>
Apr 12 07:02:37 user nova-compute[71711]:       <entry name="serial">f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4</entry>
Apr 12 07:02:37 user nova-compute[71711]:       <entry name="uuid">f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4</entry>
Apr 12 07:02:37 user nova-compute[71711]:       <entry name="family">Virtual Machine</entry>
Apr 12 07:02:37 user nova-compute[71711]:     </system>
Apr 12 07:02:37 user nova-compute[71711]:   </sysinfo>
Apr 12 07:02:37 user nova-compute[71711]:   <os>
Apr 12 07:02:37 user nova-compute[71711]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 07:02:37 user nova-compute[71711]:     <boot dev="hd"/>
Apr 12 07:02:37 user nova-compute[71711]:     <smbios mode="sysinfo"/>
Apr 12 07:02:37 user nova-compute[71711]:   </os>
Apr 12 07:02:37 user nova-compute[71711]:   <features>
Apr 12 07:02:37 user nova-compute[71711]:     <acpi/>
Apr 12 07:02:37 user nova-compute[71711]:     <apic/>
Apr 12 07:02:37 user nova-compute[71711]:     <vmcoreinfo/>
Apr 12 07:02:37 user nova-compute[71711]:   </features>
Apr 12 07:02:37 user nova-compute[71711]:   <clock offset="utc">
Apr 12 07:02:37 user nova-compute[71711]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 07:02:37 user nova-compute[71711]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 07:02:37 user nova-compute[71711]:     <timer name="hpet" present="no"/>
Apr 12 07:02:37 user nova-compute[71711]:   </clock>
Apr 12 07:02:37 user nova-compute[71711]:   <cpu mode="custom" match="exact">
Apr 12 07:02:37 user nova-compute[71711]:     <model>Nehalem</model>
Apr 12 07:02:37 user nova-compute[71711]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 07:02:37 user nova-compute[71711]:   </cpu>
Apr 12 07:02:37 user nova-compute[71711]:   <devices>
Apr 12 07:02:37 user nova-compute[71711]:     <disk type="block" device="disk">
Apr 12 07:02:37 user nova-compute[71711]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 07:02:37 user nova-compute[71711]:       <source dev="/dev/sdc"/>
Apr 12 07:02:37 user nova-compute[71711]:       <target dev="vda" bus="virtio"/>
Apr 12 07:02:37 user nova-compute[71711]:       <serial>6836b4d5-ab04-46f5-bd65-97daf28c5c63</serial>
Apr 12 07:02:37 user nova-compute[71711]:     </disk>
Apr 12 07:02:37 user nova-compute[71711]:     <interface type="ethernet">
Apr 12 07:02:37 user nova-compute[71711]:       <mac address="fa:16:3e:90:7d:af"/>
Apr 12 07:02:37 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 07:02:37 user nova-compute[71711]:       <mtu size="1442"/>
Apr 12 07:02:37 user nova-compute[71711]:       <target dev="tap1650e68d-e1"/>
Apr 12 07:02:37 user nova-compute[71711]:     </interface>
Apr 12 07:02:37 user nova-compute[71711]:     <serial type="pty">
Apr 12 07:02:37 user nova-compute[71711]:       <log file="/opt/stack/data/nova/instances/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4/console.log" append="off"/>
Apr 12 07:02:37 user nova-compute[71711]:     </serial>
Apr 12 07:02:37 user nova-compute[71711]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 07:02:37 user nova-compute[71711]:     <video>
Apr 12 07:02:37 user nova-compute[71711]:       <model type="virtio"/>
Apr 12 07:02:37 user nova-compute[71711]:     </video>
Apr 12 07:02:37 user nova-compute[71711]:     <rng model="virtio">
Apr 12 07:02:37 user nova-compute[71711]:       <backend model="random">/dev/urandom</backend>
Apr 12 07:02:37 user nova-compute[71711]:     </rng>
Apr 12 07:02:37 user nova-compute[71711]:     <controller type="usb" index="0" model="none"/>
Apr 12 07:02:37 user nova-compute[71711]:     <memballoon model="virtio">
Apr 12 07:02:37 user nova-compute[71711]:       <stats period="10"/>
Apr 12 07:02:37 user nova-compute[71711]:     </memballoon>
Apr 12 07:02:37 user nova-compute[71711]:   </devices>
Apr 12 07:02:37 user nova-compute[71711]: </domain>
Apr 12 07:02:37 user nova-compute[71711]:  {{(pid=71711) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-321254683',display_name='tempest-TestVolumeBootPattern-server-321254683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-321254683',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNbv/mQ5Jh7d3el2izrg+GDxn92QeO4zMIlTzLidAMtY3y/RJv3zDhTt+tusQuaHyr/g+rWCCyv+CQw77GLblNFXZcxdLxTAy4+wGytUE4zISxmCGpwWgUZaZVTfqOmhA==',key_name='tempest-TestVolumeBootPattern-1253801261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-h6hc4ls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T07:02:32Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1650e68d-e118-40ee-90dd-608846dcf213", "address": "fa:16:3e:90:7d:af", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1650e68d-e1", "ovs_interfaceid": "1650e68d-e118-40ee-90dd-608846dcf213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "1650e68d-e118-40ee-90dd-608846dcf213", "address": "fa:16:3e:90:7d:af", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1650e68d-e1", "ovs_interfaceid": "1650e68d-e118-40ee-90dd-608846dcf213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1650e68d-e118-40ee-90dd-608846dcf213,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1650e68d-e1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG os_vif [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1650e68d-e118-40ee-90dd-608846dcf213,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1650e68d-e1') {{(pid=71711) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1650e68d-e1, may_exist=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1650e68d-e1, col_values=(('external_ids', {'iface-id': '1650e68d-e118-40ee-90dd-608846dcf213', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:7d:af', 'vm-uuid': 'f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4'}),)) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:02:37 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:38 user nova-compute[71711]: INFO os_vif [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1650e68d-e118-40ee-90dd-608846dcf213,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1650e68d-e1')
Apr 12 07:02:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] No BDM found with device name vda, not building metadata. {{(pid=71711) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 07:02:38 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] No VIF found with MAC fa:16:3e:90:7d:af, not building metadata {{(pid=71711) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 07:02:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0d59054c-8e5f-4078-8431-0716b27b5d19 req-f3b3cd80-79b2-4af5-a70b-62ed1c4b4da7 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Received event network-vif-plugged-1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:02:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0d59054c-8e5f-4078-8431-0716b27b5d19 req-f3b3cd80-79b2-4af5-a70b-62ed1c4b4da7 service nova] Acquiring lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:02:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0d59054c-8e5f-4078-8431-0716b27b5d19 req-f3b3cd80-79b2-4af5-a70b-62ed1c4b4da7 service nova] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:02:39 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-0d59054c-8e5f-4078-8431-0716b27b5d19 req-f3b3cd80-79b2-4af5-a70b-62ed1c4b4da7 service nova] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:02:39 user nova-compute[71711]: DEBUG nova.compute.manager [req-0d59054c-8e5f-4078-8431-0716b27b5d19 req-f3b3cd80-79b2-4af5-a70b-62ed1c4b4da7 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] No waiting events found dispatching network-vif-plugged-1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:02:39 user nova-compute[71711]: WARNING nova.compute.manager [req-0d59054c-8e5f-4078-8431-0716b27b5d19 req-f3b3cd80-79b2-4af5-a70b-62ed1c4b4da7 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Received unexpected event network-vif-plugged-1650e68d-e118-40ee-90dd-608846dcf213 for instance with vm_state building and task_state spawning.
Apr 12 07:02:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282961.3422148, f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 => Resumed> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:02:41 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] VM Resumed (Lifecycle Event)
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.compute.manager [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Instance event wait completed in 0 seconds for  {{(pid=71711) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Guest created on hypervisor {{(pid=71711) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 07:02:41 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Instance spawned successfully.
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Found default for hw_cdrom_bus of ide {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Found default for hw_disk_bus of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Found default for hw_input_bus of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Found default for hw_pointer_model of None {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Found default for hw_video_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Found default for hw_vif_model of virtio {{(pid=71711) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 07:02:41 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.virt.driver [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] Emitting event <LifecycleEvent: 1681282961.3434536, f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 => Started> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:02:41 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] VM Started (Lifecycle Event)
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71711) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 07:02:41 user nova-compute[71711]: INFO nova.compute.manager [None req-bc9e1a6d-c398-4941-aa4c-cc2e4b7a888a None None] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 07:02:41 user nova-compute[71711]: INFO nova.compute.manager [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Took 4.90 seconds to spawn the instance on the hypervisor.
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.compute.manager [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-f7e0a3df-1fa6-496a-9b19-ebdd5825a59a req-991da105-4d52-476c-9b21-f790a02ab7fe service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Received event network-vif-plugged-1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f7e0a3df-1fa6-496a-9b19-ebdd5825a59a req-991da105-4d52-476c-9b21-f790a02ab7fe service nova] Acquiring lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f7e0a3df-1fa6-496a-9b19-ebdd5825a59a req-991da105-4d52-476c-9b21-f790a02ab7fe service nova] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f7e0a3df-1fa6-496a-9b19-ebdd5825a59a req-991da105-4d52-476c-9b21-f790a02ab7fe service nova] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:02:41 user nova-compute[71711]: DEBUG nova.compute.manager [req-f7e0a3df-1fa6-496a-9b19-ebdd5825a59a req-991da105-4d52-476c-9b21-f790a02ab7fe service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] No waiting events found dispatching network-vif-plugged-1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:02:41 user nova-compute[71711]: WARNING nova.compute.manager [req-f7e0a3df-1fa6-496a-9b19-ebdd5825a59a req-991da105-4d52-476c-9b21-f790a02ab7fe service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Received unexpected event network-vif-plugged-1650e68d-e118-40ee-90dd-608846dcf213 for instance with vm_state building and task_state spawning.
Apr 12 07:02:41 user nova-compute[71711]: INFO nova.compute.manager [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Took 10.03 seconds to build instance.
Apr 12 07:02:41 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-49c2d923-009f-4ae7-a30f-8d1c0c3cb792 tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.127s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:02:42 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:02:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:02:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:02:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:02:47 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:02:52 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:02:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:02:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:07 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:03:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:03:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:12 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:03:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:15 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:03:15 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:03:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:03:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:03:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:18 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:03:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:03:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 07:03:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:03:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:03:18 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:03:18 user nova-compute[71711]: DEBUG nova.objects.instance [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lazy-loading 'info_cache' on Instance uuid e50420bc-12f0-40bd-82bc-d91f38fe3eaa {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:03:18 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updating instance_info_cache with network_info: [{"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:03:18 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:03:18 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:03:20 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:03:21 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:03:21 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:03:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=26.092876434326172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing inventories for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating ProviderTree inventory for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Updating inventory in ProviderTree for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing aggregate associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, aggregates: None {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 07:03:21 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Refreshing trait associations for resource provider 1e1b2f58-6c32-4311-9037-c28244d485c6, traits: HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=71711) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 07:03:22 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:03:22 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:03:22 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:03:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:03:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:03:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:03:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:03:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:03:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:23 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:03:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:27 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:03:28 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:03:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:03:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:03:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:03:33 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:33 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:03:33 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71711) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 07:03:36 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:03:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Cleaning up deleted instances {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 07:03:36 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] There are 0 instances to clean {{(pid=71711) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 07:03:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:03:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:03:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:03:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:03:38 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:43 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:03:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:03:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:03:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:03:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:03:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:03:48 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:53 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:03:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:03:58 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:03 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:04:07 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:04:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:04:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:04:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:04:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:04:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:04:08 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:04:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:04:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:04:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:04:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:04:13 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:14 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:04:15 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:04:15 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:04:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:04:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:04:18 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:19 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:04:19 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:04:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:04:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquired lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:04:19 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Forcefully refreshing network info cache for instance {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 07:04:19 user nova-compute[71711]: DEBUG nova.network.neutron [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Updating instance_info_cache with network_info: [{"id": "1650e68d-e118-40ee-90dd-608846dcf213", "address": "fa:16:3e:90:7d:af", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1650e68d-e1", "ovs_interfaceid": "1650e68d-e118-40ee-90dd-608846dcf213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:04:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Releasing lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:04:19 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Updated the network info_cache for instance {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 07:04:21 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:04:22 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71711) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Received event network-changed-1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Refreshing instance network info cache due to event network-changed-1650e68d-e118-40ee-90dd-608846dcf213. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] Acquiring lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] Acquired lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.network.neutron [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Refreshing network info cache for port 1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:04:23 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:04:23 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=26.092182159423828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71711) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Received event network-changed-1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.compute.manager [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Refreshing instance network info cache due to event network-changed-1650e68d-e118-40ee-90dd-608846dcf213. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] Acquiring lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:04:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:04:23 user nova-compute[71711]: INFO nova.compute.manager [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Terminating instance
Apr 12 07:04:23 user nova-compute[71711]: DEBUG nova.compute.manager [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG nova.network.neutron [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Updated VIF entry in instance network info cache for port 1650e68d-e118-40ee-90dd-608846dcf213. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG nova.network.neutron [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Updating instance_info_cache with network_info: [{"id": "1650e68d-e118-40ee-90dd-608846dcf213", "address": "fa:16:3e:90:7d:af", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1650e68d-e1", "ovs_interfaceid": "1650e68d-e118-40ee-90dd-608846dcf213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-eae77de6-5437-4e16-a1a6-8b43398c5130 req-b5b6bccc-d33e-41b0-bb14-8273a42d9fb6 service nova] Releasing lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] Acquired lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG nova.network.neutron [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Refreshing network info cache for port 1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:24 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Instance destroyed successfully.
Apr 12 07:04:24 user nova-compute[71711]: DEBUG nova.objects.instance [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lazy-loading 'resources' on Instance uuid f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-321254683',display_name='tempest-TestVolumeBootPattern-server-321254683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-321254683',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNbv/mQ5Jh7d3el2izrg+GDxn92QeO4zMIlTzLidAMtY3y/RJv3zDhTt+tusQuaHyr/g+rWCCyv+CQw77GLblNFXZcxdLxTAy4+wGytUE4zISxmCGpwWgUZaZVTfqOmhA==',key_name='tempest-TestVolumeBootPattern-1253801261',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:02:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-h6hc4ls0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:02:41Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1650e68d-e118-40ee-90dd-608846dcf213", "address": "fa:16:3e:90:7d:af", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1650e68d-e1", "ovs_interfaceid": "1650e68d-e118-40ee-90dd-608846dcf213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "1650e68d-e118-40ee-90dd-608846dcf213", "address": "fa:16:3e:90:7d:af", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1650e68d-e1", "ovs_interfaceid": "1650e68d-e118-40ee-90dd-608846dcf213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1650e68d-e118-40ee-90dd-608846dcf213,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1650e68d-e1') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG os_vif [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1650e68d-e118-40ee-90dd-608846dcf213,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1650e68d-e1') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1650e68d-e1, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:04:24 user nova-compute[71711]: INFO os_vif [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:7d:af,bridge_name='br-int',has_traffic_filtering=True,id=1650e68d-e118-40ee-90dd-608846dcf213,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1650e68d-e1')
Apr 12 07:04:24 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRiAsNwu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:04:24 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:04:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87c5e91-0ced-4cbe-bd5d-29dd9d6f6440]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:04:24 user nova-compute[71711]: No targets found.
Apr 12 07:04:24 user nova-compute[71711]: iSNS:
Apr 12 07:04:24 user nova-compute[71711]: No targets found.
Apr 12 07:04:24 user nova-compute[71711]: STATIC:
Apr 12 07:04:24 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b
Apr 12 07:04:24 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:04:24 user nova-compute[71711]:                 Iface Name: default
Apr 12 07:04:24 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63
Apr 12 07:04:24 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:04:24 user nova-compute[71711]:                 Iface Name: default
Apr 12 07:04:24 user nova-compute[71711]: FIRMWARE:
Apr 12 07:04:24 user nova-compute[71711]: No targets found.
Apr 12 07:04:24 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:04:24 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:04:24 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[be84688f-a72f-4715-849a-88c1a40233a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9916e24-79f0-4af9-ac4f-efa8491fc0c6]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 07:04:24 user nova-compute[71711]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 (non-flash)
Apr 12 07:04:24 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 07:04:24 user nova-compute[71711]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 (non-flash)
Apr 12 07:04:24 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9954260ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63'): ({'sdc'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Removing single pathed devices sdc {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e73fd07-3f18-4498-b5b0-97464aacb195]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:04:24 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb95fe3-02ca-4ebe-a1c8-8ea32a75ee9c]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flushing IO for device /dev/sdc {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c504c06c-d015-4baa-ae94-3b0d6643e2ea]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cb859b-70c0-49b8-b593-c9fddb606540]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] SCSI volumes sdc have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG nova.network.neutron [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Updated VIF entry in instance network info cache for port 1650e68d-e118-40ee-90dd-608846dcf213. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG nova.network.neutron [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Updating instance_info_cache with network_info: [{"id": "1650e68d-e118-40ee-90dd-608846dcf213", "address": "fa:16:3e:90:7d:af", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1650e68d-e1", "ovs_interfaceid": "1650e68d-e118-40ee-90dd-608846dcf213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-f7786fa1-001a-43de-a2cd-70a3c934b4c4 req-a3142185-5ee0-4aa0-8412-c794537fe820 service nova] Releasing lock "refresh_cache-f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[139002bc-7ade-4be2-a7c0-2f8a4b7833ec]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1dc221-6c2d-4b98-880d-6e3ad31912b5]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63, portal: 172.16.0.220,3260]
Apr 12 07:04:25 user nova-compute[71711]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63, portal: 172.16.0.220,3260] successful.
Apr 12 07:04:25 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6836b4d5-ab04-46f5-bd65-97daf28c5c63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[935c1126-a846-498b-9816-fdb9d61dca12]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== disconnect_volume: return (383ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:04:25 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Deleting instance files /opt/stack/data/nova/instances/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4_del
Apr 12 07:04:25 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Deletion of /opt/stack/data/nova/instances/f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4_del complete
Apr 12 07:04:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Received event network-vif-unplugged-1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] Acquiring lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] No waiting events found dispatching network-vif-unplugged-1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Received event network-vif-unplugged-1650e68d-e118-40ee-90dd-608846dcf213 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Received event network-vif-plugged-1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] Acquiring lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG nova.compute.manager [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] No waiting events found dispatching network-vif-plugged-1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:04:25 user nova-compute[71711]: WARNING nova.compute.manager [req-b7638f05-b658-413a-b7e2-e8cea5615a81 req-faa7a1ed-2303-475a-b22d-527b5edb4064 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Received unexpected event network-vif-plugged-1650e68d-e118-40ee-90dd-608846dcf213 for instance with vm_state active and task_state deleting.
Apr 12 07:04:25 user nova-compute[71711]: INFO nova.compute.manager [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Took 1.32 seconds to destroy the instance on the hypervisor.
Apr 12 07:04:25 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:04:25 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:04:25 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Took 0.54 seconds to deallocate network for instance.
Apr 12 07:04:26 user nova-compute[71711]: INFO nova.compute.manager [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Took 0.80 seconds to detach 1 volumes for instance.
Apr 12 07:04:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:04:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:04:26 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:04:26 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:04:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:04:26 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Deleted allocations for instance f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4
Apr 12 07:04:26 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-4745896a-d910-4020-80c2-6e402b30581a tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.952s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:04:27 user nova-compute[71711]: DEBUG nova.compute.manager [req-79acab41-ea25-4f57-b800-5725d708f769 req-78b2fa76-5415-4885-8a7e-d10c81531f75 service nova] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Received event network-vif-deleted-1650e68d-e118-40ee-90dd-608846dcf213 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:04:28 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:04:29 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:34 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:04:36 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:04:39 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681283064.774401, f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4 => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:04:39 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] VM Stopped (Lifecycle Event)
Apr 12 07:04:39 user nova-compute[71711]: DEBUG nova.compute.manager [None req-ab62d763-6fe0-470a-8198-3cf25fc95509 None None] [instance: f8e49ec4-f5bc-4276-b976-9b0f0aeca9b4] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:04:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:04:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:04:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:04:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:04:39 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:44 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:49 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:04:54 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:04:59 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:04 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:08 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:05:09 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:05:14 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:05:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:05:14 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:05:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:05:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:05:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Received event network-changed-db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG nova.compute.manager [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Refreshing instance network info cache due to event network-changed-db6994d3-6239-4f48-b696-63d53248e164. {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] Acquiring lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] Acquired lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG nova.network.neutron [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Refreshing network info cache for port db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:05:19 user nova-compute[71711]: INFO nova.compute.manager [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Terminating instance
Apr 12 07:05:19 user nova-compute[71711]: DEBUG nova.compute.manager [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Start destroying the instance on the hypervisor. {{(pid=71711) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:19 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Skipping network cache update for instance because it is being deleted. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.network.neutron [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updated VIF entry in instance network info cache for port db6994d3-6239-4f48-b696-63d53248e164. {{(pid=71711) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.network.neutron [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updating instance_info_cache with network_info: [{"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-5be8dc6d-9d5f-4993-8f2f-e4860c55a837 req-db7a74a1-601a-4391-8b97-67e5b652a1ba service nova] Releasing lock "refresh_cache-e50420bc-12f0-40bd-82bc-d91f38fe3eaa" {{(pid=71711) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 07:05:20 user nova-compute[71711]: INFO nova.virt.libvirt.driver [-] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Instance destroyed successfully.
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.objects.instance [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lazy-loading 'resources' on Instance uuid e50420bc-12f0-40bd-82bc-d91f38fe3eaa {{(pid=71711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.vif [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T07:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1873720950',display_name='tempest-TestVolumeBootPattern-server-1873720950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1873720950',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNbv/mQ5Jh7d3el2izrg+GDxn92QeO4zMIlTzLidAMtY3y/RJv3zDhTt+tusQuaHyr/g+rWCCyv+CQw77GLblNFXZcxdLxTAy4+wGytUE4zISxmCGpwWgUZaZVTfqOmhA==',key_name='tempest-TestVolumeBootPattern-1253801261',keypairs=<?>,launch_index=0,launched_at=2023-04-12T07:00:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d1513e8b784c758412ddfc2692bb22',ramdisk_id='',reservation_id='r-2sqtu976',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-294210775',owner_user_name='tempest-TestVolumeBootPattern-294210775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T07:00:43Z,user_data=None,user_id='1fec39f776464d339142eeed1ba95a6d',uuid=e50420bc-12f0-40bd-82bc-d91f38fe3eaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converting VIF {"id": "db6994d3-6239-4f48-b696-63d53248e164", "address": "fa:16:3e:86:03:84", "network": {"id": "9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-394913054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d1513e8b784c758412ddfc2692bb22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6994d3-62", "ovs_interfaceid": "db6994d3-6239-4f48-b696-63d53248e164", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.network.os_vif_util [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:03:84,bridge_name='br-int',has_traffic_filtering=True,id=db6994d3-6239-4f48-b696-63d53248e164,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6994d3-62') {{(pid=71711) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_vif [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:03:84,bridge_name='br-int',has_traffic_filtering=True,id=db6994d3-6239-4f48-b696-63d53248e164,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6994d3-62') {{(pid=71711) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb6994d3-62, bridge=br-int, if_exists=True) {{(pid=71711) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:05:20 user nova-compute[71711]: INFO os_vif [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:03:84,bridge_name='br-int',has_traffic_filtering=True,id=db6994d3-6239-4f48-b696-63d53248e164,network=Network(9c705401-ee69-4eb7-a1e1-a9b8dcde7d7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6994d3-62')
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] calling os-brick to detach iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f995c2c0190>, {'target_iqn': 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hRcotZzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 07:05:20 user nova-compute[71711]: WARNING os_brick.initiator.connectors.base [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed14fac8-4d94-4bd5-b736-6255d13df271]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 07:05:20 user nova-compute[71711]: No targets found.
Apr 12 07:05:20 user nova-compute[71711]: iSNS:
Apr 12 07:05:20 user nova-compute[71711]: No targets found.
Apr 12 07:05:20 user nova-compute[71711]: STATIC:
Apr 12 07:05:20 user nova-compute[71711]: Target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b
Apr 12 07:05:20 user nova-compute[71711]:         Portal: 172.16.0.220:3260,-1
Apr 12 07:05:20 user nova-compute[71711]:                 Iface Name: default
Apr 12 07:05:20 user nova-compute[71711]: FIRMWARE:
Apr 12 07:05:20 user nova-compute[71711]: No targets found.
Apr 12 07:05:20 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 07:05:20 user nova-compute[71711]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 07:05:20 user nova-compute[71711]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71711) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b', 0)] {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf59d3d-6801-4952-893b-0805863c1735]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cf0e37-2255-4d1b-a5cc-199abefb2630]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 07:05:20 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b (non-flash)
Apr 12 07:05:20 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f994416ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b'): ({'sdb'}, set())}) {{(pid=71711) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Removing single pathed devices sdb {{(pid=71711) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e0e24c-4ad5-428c-a7bf-51a7dbcdfeeb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a793eb-c7c0-41fb-b742-e7da509dc389]: (4, ('ok\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Flushing IO for device /dev/sdb {{(pid=71711) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b26b6d-a2cf-4831-a573-3fb46184adfc]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71711) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fdb846-53d1-4029-bacc-9ca5e177f57b]: (4, ('1', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.linuxscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] SCSI volumes sdb have been removed. {{(pid=71711) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_49f02b59', '/dev/disk/by-id/scsi-1SCST_BIO49f02b59-419dafea0aadac2b', '/dev/disk/by-id/scsi-23431396461666561') {{(pid=81777) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5e472a-7947-4451-b343-2b8560bb4a77]: (4, None) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b')] {{(pid=71711) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba11b8d-168e-4061-bc6b-d911e57e195b]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --logout {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8131040-80db-4e5d-8ef1-07c2ba27804d]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260]
Apr 12 07:05:20 user nova-compute[71711]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b, portal: 172.16.0.220,3260] successful.
Apr 12 07:05:20 user nova-compute[71711]:  stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op delete {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1640bd09-1264-4e82-9e6e-0f1fa3cc654b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81777) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc90f9ea-927c-4d4b-bc73-05aed6742e0c]: (4, ('', '')) {{(pid=81777) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71711) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.base [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG os_brick.initiator.connectors.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] <== disconnect_volume: return (325ms) None {{(pid=71711) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Disconnected iSCSI Volume {{(pid=71711) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 07:05:20 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Deleting instance files /opt/stack/data/nova/instances/e50420bc-12f0-40bd-82bc-d91f38fe3eaa_del
Apr 12 07:05:20 user nova-compute[71711]: INFO nova.virt.libvirt.driver [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Deletion of /opt/stack/data/nova/instances/e50420bc-12f0-40bd-82bc-d91f38fe3eaa_del complete
Apr 12 07:05:20 user nova-compute[71711]: INFO nova.compute.manager [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 12 07:05:20 user nova-compute[71711]: DEBUG oslo.service.loopingcall [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71711) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.compute.manager [-] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Deallocating network for instance {{(pid=71711) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 07:05:20 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] deallocate_for_instance() {{(pid=71711) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 07:05:21 user nova-compute[71711]: DEBUG nova.network.neutron [-] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Updating instance_info_cache with network_info: [] {{(pid=71711) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 07:05:21 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Took 0.41 seconds to deallocate network for instance.
Apr 12 07:05:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Received event network-vif-unplugged-db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:05:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] Acquiring lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:05:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:05:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:05:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] No waiting events found dispatching network-vif-unplugged-db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:05:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Received event network-vif-unplugged-db6994d3-6239-4f48-b696-63d53248e164 for instance with task_state deleting. {{(pid=71711) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 07:05:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Received event network-vif-plugged-db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:05:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] Acquiring lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:05:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:05:21 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:05:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] No waiting events found dispatching network-vif-plugged-db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 07:05:21 user nova-compute[71711]: WARNING nova.compute.manager [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Received unexpected event network-vif-plugged-db6994d3-6239-4f48-b696-63d53248e164 for instance with vm_state active and task_state deleting.
Apr 12 07:05:21 user nova-compute[71711]: DEBUG nova.compute.manager [req-71f11afd-a97e-4801-a297-19062adaeb67 req-4212252b-1544-43c7-89d9-6509c1cdae9e service nova] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Received event network-vif-deleted-db6994d3-6239-4f48-b696-63d53248e164 {{(pid=71711) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 07:05:22 user nova-compute[71711]: INFO nova.compute.manager [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Took 0.72 seconds to detach 1 volumes for instance.
Apr 12 07:05:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:05:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:05:22 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:05:22 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:05:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:05:22 user nova-compute[71711]: INFO nova.scheduler.client.report [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Deleted allocations for instance e50420bc-12f0-40bd-82bc-d91f38fe3eaa
Apr 12 07:05:22 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-d136681b-a30d-4363-8f9b-652dd37d168d tempest-TestVolumeBootPattern-294210775 tempest-TestVolumeBootPattern-294210775-project-member] Lock "e50420bc-12f0-40bd-82bc-d91f38fe3eaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.556s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:05:23 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:05:23 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:05:23 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8903MB free_disk=26.09101104736328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:05:23 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:05:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:29 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:05:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:05:35 user nova-compute[71711]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681283120.4677267, e50420bc-12f0-40bd-82bc-d91f38fe3eaa => Stopped> {{(pid=71711) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 07:05:35 user nova-compute[71711]: INFO nova.compute.manager [-] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] VM Stopped (Lifecycle Event)
Apr 12 07:05:35 user nova-compute[71711]: DEBUG nova.compute.manager [None req-e8f78a32-25a0-4557-bb5a-9ca354de5089 None None] [instance: e50420bc-12f0-40bd-82bc-d91f38fe3eaa] Checking state {{(pid=71711) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 07:05:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:05:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:05:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:05:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:05:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:05:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:05:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:06:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:06:05 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:06:10 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:06:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:06:10 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:06:15 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:06:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:06:15 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:06:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:06:16 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:06:16 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71711) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 07:06:17 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:06:18 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:06:20 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:06:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Starting heal instance info cache {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 07:06:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Rebuilding the list of instances to heal {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 07:06:20 user nova-compute[71711]: DEBUG nova.compute.manager [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Didn't find any instances for network info cache update. {{(pid=71711) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 07:06:20 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Auditing locally available compute resources for user (node: user) {{(pid=71711) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 07:06:25 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:06:25 user nova-compute[71711]: WARNING nova.virt.libvirt.driver [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 07:06:25 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Hypervisor/Node resource view: name=user free_ram=8909MB free_disk=26.081775665283203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71711) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71711) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG nova.compute.provider_tree [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed in ProviderTree for provider: 1e1b2f58-6c32-4311-9037-c28244d485c6 {{(pid=71711) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG nova.scheduler.client.report [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Inventory has not changed for provider 1e1b2f58-6c32-4311-9037-c28244d485c6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71711) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG nova.compute.resource_tracker [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Compute_service record updated for user:user {{(pid=71711) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 07:06:25 user nova-compute[71711]: DEBUG oslo_concurrency.lockutils [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.123s {{(pid=71711) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 07:06:30 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:06:31 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:06:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:06:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:06:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:06:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:06:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:06:35 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:06:37 user nova-compute[71711]: DEBUG oslo_service.periodic_task [None req-7604dbed-92d0-4c79-b1d6-57b05a4d2664 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71711) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 07:06:40 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:06:45 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:06:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:06:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:06:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71711) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 07:06:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:06:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71711) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 07:06:50 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 07:06:55 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 07:07:00 user nova-compute[71711]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71711) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}